Since the first duke of England was the Duke of Cornwall, the son of Edward III, 1337, I'm going to assume that the first Duchy would be the same, Duchy of Cornwall.
The Duchy of Lancaster is held by the Soverign. in Lancaster the toast, "To the Queen, Duke of Lancaster" that's "Duke" not Duchess.