On a Sienna 2003 both tail lights are not working is there a fuse that could cause this?

Yes, in the fuse panel. Open and read your owner's manual.