Do men ever leave when there is no-one else?

Most certainly. Men don't always leave because there is someone else although I suppose it's easier to believe that then believing they just don't want to be with us.