Why was Patrick Henry not at the constitutional convention?

He said he "smelt a rat" and refused to go. He was afraid of the inevidable formation of a national government.