If you swallow your partners semen will it harm your baby?

No, not unless he has an STD. Also, Its believed that the DNA from it is good for the baby because it reduces the risk of rejection from the body. (Given that its from the babies father of course).