Why are there bumps on the back of my dog?

Hard to say without knowing the size of the bumps, where they are, what they look like, etc. I would expect a skin condition. It could be as simple as an allergy. I'd be more concerned if the number or size of the bumps is increasing. Also, of these turn out to be open sores. Talk to your vet -- and ask about prednizone.