Is setting off a firework a permanent change?

Pretty much.

There is no easy way to turn the noise, the light and the puff of smoke etc back into gunpowder.