Most simple rust removers contain phosphoric acid, which
dissolves flaky or granular rust, but does not seriously attack the
parent steel. In fact it leaves a fine coating of iron phosphate
which is a slight protective, and provides a good substrate for
paint.
Scrub off as much of the flaky scale rust as possible - for this
just wastefuly consumes the rust remover.