Could somebody file a lawsuit against the IRS?

Yes, it is legally possible to file a lawsuit against any federal agency.