Can you file a lawsuit against voters?

No. Voting rights are one of the things that people should not take for granted.

Yes. Politicians have sued voters for attempting to impose term limits.