Why the natural numbers are so called?

They are the numbers that are used for counting objects. They form the basis of the number system. Even so, why "natural", and not primary (like in colours) I don't know.