Do chickens lay infertile eggs?

Yes.

If there is no rooster present, the hen will continue to lay eggs and they will be infertile.