Does a cellphone charger use energy when it's plugged in but the cellphone is not?

Yes, as current will flow in the primary coil. But when a cellphone is added, the energy consumption is more, due to phase angle changes in the secondary coil.