Maybe. Depends on how observant they are and if he brags.
That will be hard to predict. If your husband's friend knows you to, it will be dangerous for your husband to confide to his friend, let alone be seen by him. But there are some married man's friend who knows but not with much details. If this happens, your husband's friend will be avoiding him.