1.
A person who is left out of a group for some reason, as in The invitation was for couples only, so Jane was odd man out. [Mid-1800s]
2.
Something or someone who differs markedly from the others in a group, as in Among all those ranch-style houses, their Victorian was odd man out. [Late 1800s]