Was life ever hard for lords in the middle ages?

In the middle ages Lords had to fight to defend their lands and kings. If a Lord did not fight then he could lose his land to his rival or be beheaded for disloyalty