Did Caesar Augustus and Cleopatra have children?

No, absolutely not. They were enemies. Although Cleopatra tried to seduce Augustus/Octavian, by making him "understand" her actions, Octavian would have nothing to do with her and in fact, would not even look at her when they spoke.