What is the name of the English prime ministers house?

It is normally reffered to as Number 10, Downing street or just Number 10.