ive done mine a couple of times with engine degreaser/cleaner and after a while my alternator housing discolored and looks like crap, same with all of the parts that use the same material as the alt.
soap an water should get it done, but make sure your engine isnt hot. if needed just take a day an get in there with a sponge or something an scrub it all down with car soap.