Opponents of US expansion maintained that colonizing foreign people violated their right to what?

Self-Determination.