Is it true that if you are good at math you will have problems with physics?

No, that's ridiculous, physics involves math - as do most sciences.