Was James Madison part of the Framers?

Yes - he was one of the few delegates at the Constitutional Convention with perfect attendance and it's because of Madison's notes we know so much about what went on (not to mention that 30 of the 85 Federalist Papers, including the famed 10 and 51, were written by him).