Do brown socks go with grey pants?

The rule is that the socks color should go with the shirt color and not the pants color.