Does a water pump leak when the car isn't running?

yes it will. thru a hole in bottom usually.