What was the danger for romeo going to the Capulet's party?

If he was recognized as a Montague one of the hotheaded Capulets might beat him up. As indeed Tybalt intended to do when he found out who Romeo was.