Does a hockey goal scored while a player is in the penalty box count against his plus minus rating?

No, since a player has to be on the ice in even strength situations for plus/minus to count.