Do newborn kitten go to the bathroom?

Yes, they do. Their mom stimulates them to go when she licks them and she cleans it all up.