What does it mean when he says you are a couple but not officially?

It's another way of saying, "Honey, I'm just gonna leave the door open just incase someone better comes a-knockin'."