What is the worst time of year to travel to the Caribbean?

Don't go to the Caribbean during hurricaine season. You are just asking for trouble. Answer Yes, don't go during hurricane season which is roughly between June-November. The best time to go, based on past weather patterns would be between March and May.