You'll need a capacitance meter. Some multimeters have a capacitance measurement range. If your's doesn't have one, the only thing you can test reliably is to check for a short circuit using the Ω range. A good capacitor should show a (quasi) infinite resistance.