Will the House of Windsor's name change when Charles becomes king?

No. Although last names are not normally used in royalty, the Queen and Prince Philip decided to give their children the name Mountbatten-Windsor, so it will still be the House of Windsor.