Does one have to pay for a photo enforced ticket for running a red light with a rental car in another state?

Yes.

The ticket will be mailed to the address on record - namely, the rental car agency. The rental car agency will charge your credit card for the amount of the ticket, and occasionally an additional fee. If they cannot charge your card, they can obtain a judgment against you for the amount of the ticket plus legal fees, and will do so.