What could cause the RPM gauge to go up and down while driving?

That's called the tachometer. You didn't provide much information, but maybe it only happens when you (or the automatic transmission, if you have an automatic) shift gears. If that's the case, it's normal. Shifting to a different gear at any given speed changes the RPM's of the engine. If it happens at times other than when shifting, something else is wrong.