Why is everyone so harsh on vegetarians?

It Probably works both ways. But many people feel that they need to justify their own eating preferences to people that feel they should not cause harm as a result of what they eat. When people don't have a good argument they tend to become belligerent.