I'll rinse the metal and glass ones in anything antibacterial before washing them thoroughly in hot soapy water. With silicone, I'll often let it soak in some baking soda paste for a bit to remove any smells. Just don't scrub with baking soda, it's abrasive enough to scratch the toy. Pat it on gently and then rinse it away.