How many wise men brought gifts when Jesus was born?

There is no mention of how many wise men there were. Apparently since there were three gifts mentioned, people have assumed there were three wise men, but we don't know.