I have to say, I think the fuel pump runs all the time.
Fuel pump runs, pressurises the fuel rail, then the excess fuel returns to the tank via the pressure regulator in the end of the fuel rail.

More importantly, are you saying you hear the fuel pump when you turn the key to the IGN position but before you've turned it to START? Because, if so, I think that's wrong.

James