Why is cracking your knuckles politically incorrect?

The sound of knuckles being cracked is unpleasant to some people (like the sound of a finger nail being scraped across a chalk board), thus in polite company one would normally refrain from cracking your knuckles.