Can my name be removed from a lease if my husband is staying in that rental and I'am renting another place from the same landlord without being held responsible for bills and rent at the previous rent?

This depends on if your husband is on the original lease. If other bills are in your name than the rent you are responsible for those. If the forner is true you can have your name removed.