I really wouldn't. seersucker is surprisingly "dressy", especially in the south (except shorts). I wouldn't wear a seersucker jacket with anything except the accompanying pants. Yes, any summer weight pants work with seersucker such as linen, cotton or tropical weight wool. Only men over the age of 55+ wear the accompanying seersucker pants. A more youthful and modern approach is to wear different pants with the jacket. I am a NYC fashion Designer so you can trust my advice.