As you rise in elevation, the pressure around you decreases. This lower pressure would cause the balloon to expand, and burst if it was inflated to much originally. By starting it off only partly filled, it will expand to a normal size and not explode.