Are policemen required to carry a weapon when they are off duty?

It depends on the department regulations.

Some departments require off-duty officers to be armed, and some leave it up to the officer.