Is there a song by the Beatles that has Just walk away in the lyrics?

No. "Walk Away Renee" was by the Left Banke.