Do you need a pass port to go to the Caribbean islands?

From the US, you don't need a passport for Puerto Rico or the US Virgin Islands. You do need a passport for all of the other islands. It is a good idea to take it along even when visiting the USVI in case you wish to take a ferry to the British Virgin Islands (BVI).