I see.

Generally "remove and replace" means take a part off and put a new one or other used one in it's place.

OK...in this case I refer to my very first post here. I have heard of some people supposedly getting away with loosening the pick-up to pump bolt then using mechanic's wire to keep it from falling into the pan before removing it completely. You must then tweak the tube ever so slightly while maneuvering the pump in the proper direction to get it free. I have never tried it but there was a write up a few years ago in one of the magazines (Chevy High Performance?) on how they did it.