Run a few and shut off is how it's designed to work. It's supposed to build up pressure and then turn off until the engine starts. If you start the engine the pump is supposed to stay on until the engine is off again. It goes by tach input so it could be affected by the cam or crank position sensors. I'd check for correct fuel pressure at the rail.