Was the constitution written on hemp paper?

No, the final copies are written on parchment paper (animal skin).
It was rumored to be drafted on Dutch hemp paper, however, according to Monticello.org, it was more likely to have been made from flax or linen.