Taking note of the limitations of the common government (the Confederation Congress, aka, Congress of the Confederation, or sometimes even referred to still as the Continental Congress), certain members of our founding generation instigated for a Convention to amend that government. Eventually, in February 1787, Congress called for such a Convention to meet in May in Philadelphia "to devise such further provisions as shall appear to them necessary to render the constitution of the Federal Government [the Articles of Confederation] adequate to the exigencies of the Union." And so, the Convention did convene on May 25, 1787 in Philadelphia with delegates from all the states except Rhode Island. The Constitutional Convention, as it came to be known, quickly changed direction - from amending the Articles of Confederation to designing an altogether different form of government. James Madison would be the architect of that plan (the Virginia Plan). The collective wisdom of the delegates at the Convention identified the weakness of the Virginia Plan, which for the colonies was the creation of a "national" government, with concentrated power in that government, rather than a "federal" government which left most of the sovereign power with the states. A federal government, with the sovereignty of the States keeping the sovereign power of the federal government in check, was the form of government that the delegates preferred. A government that could remain checked against abuses was one that honored the fiercely independent and freedom-loving nature of the colonies and one which would address the reasons for the revolution against Great Britain.
In the summer of 1787, delegates from the 13 states convened in Philadelphia and drafted a remarkable blueprint for self-government - the Constitution of the United States. The first draft set up a system of checks and balances that included a strong executive branch, a representative legislature and a federal judiciary.

The Constitution was remarkable, but deeply flawed. For one thing, it did not include a specific declaration - or bill - of individual rights. As it turned out, and luckily for us as depositories of certain "inalienable rights" as well as civil rights (those belonging to individuals living in a society, subject to the rule of law), the lack of a Bill of Rights turned out to be an obstacle to the Constitution's ratification by the states that could not be overcome. The Federalists opposed including a bill of rights on the ground that it was unnecessary. According to James Madison, a leading Federalist, a Bill of Rights was not necessary, arguing that because the general government was one of limited powers, having only those powers specifically delegated to it and none touching on individual rights. Besides, he said, a Bill of Rights would only create confusion (inferring that any other right or privilege not listed in the Bill of Rights would be fair game for federal regulation) and also, state governments could ensure these freedoms without the need for a federal mandate. The Anti-Federalists, who were afraid of a strong centralized government and knowing that history has clearly shown that governments tend to concentrate power and tend towards centralization and then tyranny/abuse, refused to support the Constitution without one.
At the close of the Philadelphia Convention, on September 20, 1787, the delegates left with mixed feelings about the document they drafted. Of the 55 delegates to the Convention, only 39 signed it. Of the 16 that did not sign, some left early (for business, health reasons, family concerns, or out of protest) and some refused to sign out of protest. Some of the more important delegates (ie, position and/or influence in their states) who refused to sign were the following: George Mason of Virginia (because it did not contain a Bill of Rights), Luther Martin of Maryland (because it violated states' rights), John Mercer of Maryland (because it did not contain a Bill of Rights), Elbridge Gerry of Massachusetts (because it did not contain a Bill of Rights), John Lansing and Robert Yates, both of New York (because it created too strong of a government, which he characterized as much more "national" than "federal"), and Edmund Randolph of Virginia (because it contained insufficient checks and balances to prevent government abuse). Had some of our most active and influential founding fathers attended the Convention, there would have been far greater opposition to the final product. Those who refused to attend or who were unable to included: Patrick Henry (refused to attend, he "smelled a rat" who he believed would try to vest the common government with too much power), Richard Henry Lee (refused to attend because he too didn't trust the motives of those who called it), Thomas Jefferson (was acting as Ambassador to France at the time, but offered to advise the delegates by correspondence), John Adams (was acting as Ambassador to Great Britain at the time), Samuel Adams (refused to attend because he rejected the purpose of the Convention) and John Hancock (refused to attend for the same reason as Sam Adams).
Many of those who refused to sign the Constitution vowed to fight its ratification at the state conventions - George Mason, Elbridge Gerry, the delegates from Maryland, Luther Martin and John Mercer, and the delegates from New York, John Lansing and Robert Yates. And some strong anti-Federalists who were not delegates at Philadelphia would oppose it as well -Richard Henry Lee, Sam Adams, John Hancock, James Monroe (Virginia), and New York's Governor George Clinton (who wrote several anti-Federalist essays under the pen name "Cato"). Add to these "big guns" the biggest ones of all - Thomas Jefferson, who was as strong a proponent of a Bill of Rights as one could be, and Patrick Henry, perhaps our most vocal and passionate orator for liberty. Jefferson would have advised Madison to include one, and certainly would have taken issue with Madison's position on the matter, even though he would have had to do so by correspondence. Perhaps that is the reason why Madison lapsed during the final days of the Convention in updating Jefferson as to the discussions and decisions made in the Convention. It wasn't until a month after the Convention wrapped up, on October 24, that he finally wrote to him again and sent him a copy of the draft Constitution. We do know that as the debate intensified over a Bill of Rights, Jefferson wrote Madison with his strong opinion, including his letter of December 20, 1787, in which he wrote: "A bill of rights is what the people are entitled to against every government on earth, general or particular, and what no just government should refuse." [The Appendix at the end of this article contains the full commentary in Jefferson's letter relating to the lack of Bill of Rights in the new Constitution].
On September 28, 1787, the Confederation Congress (aka, Congress of the Confederation) advised the states to begin calling their ratifying conventions, and several did so immediately. Madison left the Philadelphia Convention uncertain what the outcome of the ratification process would be. The dissent by Edmund Randolph and George Mason, both from his home state, and then their refusal to attach their names to the Constitution weighed very heavily on his mind. As Kevin Gutzman pointed out in his book James Madison and the Making of America, the influence that those two men alone had in the overall ratification process potentially could more than counter the entire "unanimity" of the Convention.
As we will see, Madison not only played a leading role in bringing about the Philadelphia Convention (he and Alexander Hamilton orchestrated the report to the Confederation Congress - the Annapolis Report - which made the recommendation that a convention be called in May 1787 in Philadelphia to address the defects of the Articles of Confederation), but he also played a critical supporting role (through his writings) in the debates in the state ratifying conventions, and then a more formal role when ratification seemed to be doomed. The Constitution was "his baby" and he was going to do all he could to see it adopted and a stronger union created. [In September 1786, a conference was called in Annapolis, Maryland to discuss the state of commerce in the fledgling nation. The national government had no authority to regulate trade between and among the states. The conference was called by Virginia, at the urging of Madison, to discuss ways to facilitate commerce and establish standard rules and regulations. Only five of the 13 states sent any delegates at all].

Between November 20, 1787 and January 9, 1788, five states - Delaware, Pennsylvania, New Jersey, Georgia, and Connecticut - ratified the Constitution with relative ease, although the bitter minority report of the Pennsylvania opposition was widely circulated. Despite overwhelming success with these early conventions, the Federalists were well aware of the difficulties that lay ahead. Massachusetts, New Hampshire, Virginia, and New York were still to come and they knew that North Carolina and Rhode Island weren't going to sign. In other words, the difficult journey still lied ahead because the anti-Federalist (opponents of the proposed Constitution) were aggressively campaigning against ratification, six states were in doubt, and the magic number of 9 states (Article VII - when 9 states ratified the Constitution, it would take effect) might never be achieved.
In the month after the close of the Convention, Madison found himself in New York and with some time to spare. It didn't look good; too many political heavyweights were lining up against ratification. New York was unlikely to approve the Constitution. When John Lansing and Robert Yates abandoned the Philadelphia Convention, as Gutzman wrote,
"they said that they had not been sent to Philadelphia to replace the Confederation with a national government." New York's strongest political figure, its Governor, George Clinton, sided with Lansing and Yates. Alexander Hamilton, a delegate to the Convention from NY, advised Madison that the best way to improve the chances of ratification in his state was to appeal directly to the electorate through the newspapers. After all, several anti-Federalists were already writing articles and other publications criticizing the Constitution and condemning the ambitious government it believed it created.
In addition to the anti-Federalist essays written by Governor Clinton ("Cato"), there were other, also powerful, essays published to criticize the Constitution and to highlight its many flaws. There was "Brutus" from New York (likely Robert Yates or Melancton Smith, or maybe even John Williams), "Centinel" from Pennsylvania (Samuel Bryan), "Agrippa" from Massachusetts (James Winthrop), and the "Federal Farmer" from Virginia (most likely Richard Henry Lee, or maybe Mercy Otis Warren). The is no list to identify with certainty which individuals authored the essays. Agrippa published 11 Letters "To the people," and 5 essays "To the Massachusetts Convention" by February 5. Brutus published 11 of his 16 essays, Cato published all of his 7 essays, Centinel published 14 of his 18 letters, and Federal Farmer published all of his 18 letters between October 1787 and the start of the Massachusetts ratifying convention, which was January 9, 1788. Much to the dismay of the Federalists, the flood of Anti-federalist essays were starting to have their impact on the electorate and on more importantly, on the election of delegates, and key conventions were yet to meet (namely, New York and Virginia). In fact, in both those states, the majority of delegates selected would be anti-Federalists.
[New York would call for its convention on February 1, select its delegates from April 29 to May 3, and set its date for June 17. Virginia would select its delegates in March, and set a date of June 2 for its convention].
Alexander Hamilton, James Madison, and prominent NY figure, lawyer John Jay agreed to address the anti-Federalist campaign, convinced that rejection of the Constitution would condemn the states to an unworkable union. It is likely that Madison took charge from the beginning, laying out a theme or roadmap for the essays, making sure that the criticisms of the anti-federalists were addressed, making sure the provisions of the Constitution that were most contentious were addressed and effectively explained, and that the arguments in favor of the Constitution were made that he wanted. When Jay became very ill, the bulk of the essays would have to be split between Hamilton and Madison; Jay would only be able to write 3 essays. The three men responded to each and every one of the criticisms of the anti-Federalist, in essay form, under the pen name "Publius." Beginning in October 1787, these men penned 85 essays for New York newspapers and later collected them into 2 volumes entitled The Federalist (later to be referred to as The Federalist Papers), which addressed each concern of the anti-Federalists, analyzed the Constitution, detailed the thinking of the framers, anticipated scenarios posed by the critics, and explained what each provision meant. The Federalist Papers gave assurances that the fears of the anti-Federalists were unfounded and mere speculation and conjecture. One reading the Federalist Papers would believe the federal government to be one of strict and limited powers and without any threat of overstepping or abusing its powers. Comparing the government explained in the Federalist Papers to the one today would be to compare a pea to a grapefruit.
In contrast to its predecessor states (Delaware, Pennsylvania, New Jersey, Georgia, and Connecticut), the Massachusetts convention was angry and contentious, and at one point, it erupted into a fistfight between Federalist delegate Francis Dana and anti-Federalist Elbridge Gerry when the latter was not allowed to speak. The impasse was resolved only when revolutionary heroes and leading anti-Federalists Samuel Adams and John Hancock agreed to ratification on the condition that the convention also propose amendments. In other words, Massachusetts' ratification was a "conditional" one. [The convention's proposed amendments included a requirement for grand jury indictment in capital cases, which would form part of the Fifth Amendment, and an amendment reserving powers to the states not expressly given to the federal government, which would later form the basis for the Tenth Amendment. Massachusetts' Ratification is provided in the Appendix at the end of this article].
The next contentious convention would be in Virginia - in June.
At this point, I wanted to provide a timeline of the State Ratifying Conventions:
Timeline of State Ratifying Conventions:
Delaware - December 7, 1787 - Delaware ratified the Constitution, 30-0. [http://teachingamericanhistory.org/library/document/delaware-ratifies-30-0/ ]
Pennsylvania - December 12, 1787 - Pennsylvania ratified, 46-23. [http://teachingamericanhistory.org/library/document/pennsylvania-ratifies-46-23/ ]
New Jersey - December 18, 1787 - New Jersey ratified, 38-0. [http://teachingamericanhistory.org/library/document/new-jersey-ratifies-38-0/ ]
Georgia - December 31, 1787 - Georgia ratified, 20-0. [http://teachingamericanhistory.org/library/document/georgia-deed-of-ratification/ ]
Connecticut - January 9, 1787 - Connecticut ratified 128-40. [http://teachingamericanhistory.org/library/document/connecticut-ratifies-128-40/]
Massachusetts - February 6, 1788 - The delegates to the Massachusetts Ratifying Convention were split on whether to ratify the Constitution or reject it, and so they came up with a compromise. The high road explanation is that responsible leaders from both parties, including Adams and Hancock, convened and said,
"Look, we've been at this now for nearly a month. We're not making any progress whatsoever. The country is in crisis and if Massachusetts doesn't sign, then we're down the tubes. Is there some way we can come to some common ground on this?" And the common ground was that Massachusetts would ratify now with an expectation that in the First Congress amendments would be proposed to alter the Constitution. This is known as the Massachusetts Compromise. And enough people bought into it because Hancock bought into it, that it swayed enough delegates to ensure ratification. So the high ground is the sense of crisis, the sense of duty, the sense of Hamilton's remark in Federalist 85 that states would be better off signing quickly and working within the system, and that sense that Massachusetts had a responsibility to step up and take the lead. Ultimately, the Massachusetts Ratifying Convention ratified 187-168 with 9 proposed amendments - again with the understanding and expectation that a Bill of Rights would be added. [http://teachingamericanhistory.org/ratification/stagethree/ ]