Amir believes Assef doesn't harass him as much as the other people because they have a complicated history stemming from childhood, which influences Assef's behavior towards Amir. Assef also sees Amir as beneath him due to social status and ethnicity, so he may target others more aggressively.