Is helium nontoxic?

Yes. Helium is inert and thus nontoxic. People who have died from inhaling helium did not die because of the helium, it was because they weren't inhaling oxygen.