Can you drive without insurance with a provisional license?

No. Your having a provisional licence doesn't change your state's insurance requirements.

Added: The status of your license or permit has nothing to do with whether the vehicle itself is insured or not.