Not sure if acetone will but most hardware stores sell silicone remover. Whether it's on the cap or the mirror housing, I would think just scrape it off though...