Who were the presidents that were possibly gay?

There has been some speculation about James Buchanan. He never married, and lived with another man.