Would the children of the deceased parents go the fathers parents or the mothers?

This would depend on the Will. If not addressed, were the parents married? If not, the paternal grandparents have not claim as unmarried fathers have no assumed rights. Otherwise, if the parents were married, and no Will exist, than it would be a matter for the Probate court.