Is it wrong to be in love with a married man and his wife is disabled?

The issue is not being in love with a married man, we all have fantasies and desires. The issue is ACTING or your thoughts and your love for the married Man. Even if his wife was not disabled it is still wrong to have relations with a committed man.