When babies are born did they have a tail?

Not if they are human. Human babies do not have tails. Animals with tails are born with tails.