What can you do get someone out of your house if they are not on the lease but has a bill in their name?

You could have them sign the lease in order to stay in the house, so that they are responsible for the house as well. If you want them to move out, then make it happen--you would set up the utility in your name.

Call the police and have them removed. They have no right to stay in your home / property that you occupy without your consent.