Why wasnt president Andrew Johnson removed from office?

Because he is allowed to fire someone from the cabinet because he was the one who hired him/her