What could cause a strange sound from the front whenever going through rough road but disappear with the slightest touch of the brake pedal?

You don't say what kind of vehicle , or describe the sound . I would check the wheel bearings or for front wheel drive the CV joint . More info is needed to diagnose properly. answer sounds more like worn brakes or anti rattle clips on brakes have gone