Was Botany Bay in New South Wales?

Yes. Botany Bay was, and is, in New South Wales.