Can they still charge you all late fees and interest if you cancel your credit card?

If there is an outstanding account balance. Closing/canceling the account will not eliminate any fees or penalties that were in the agreement when the account was opened. There might also be an annual charge even though the account has been deactivated.