Because John Brown was outnumbered and he should have had a lot more people to start with. Few black or white Americans were prepared to join a rebellion led by a fanatical abolitionist.
personal liberty laws
He hoped to inspire a revolution that would end slavery.