Can you activate Wind-up Rat's effect in order to activate Wind-up Magician's effect even if there's no monster in your graveyard in Yu-Gi-Oh?

No. Wind-Up Rat's effect is targeted and can't be activated if there's no valid target.