Of course not. Certainly, you won't be bad at physics or engineering BECAUSE OF your math skills. You NEED math for physics, and both math and physics for engineering, so somebody who is not good at math is more likely to have trouble with physics or engineering.