Were all the continents once joined together?

Yes, they were. The combination of the continents was called Pangaea.