Is New South Wales a country?

No. New South Wales is a state in the country of Australia.

The country of "Wales", after which New South Wales was named, is in the UK.