Only when it's being used as an adjective. If one says "These requests will be evaluated on a case-by-case basis," there should be hyphenation.
However, if the phrase is used as a noun or an adverb, it will not have hyphenation, like so: "We will review these requests case by case."
Basically, if it's modifying, or affecting the meaning of, a noun, it should be hyphenated. If it's affecting a verb (in the second case, HOW reviewing is done), then it need not be hyphenated.
It is not hyphenated.
Motorcycle is not hyphenated
No it's not hyphenated.
words are only hyphenated when they have a separate meaning when separated than they do when hyphenated
It can be. Some words can be seen both hyphenated and non-hyphenated.
Yes it should be hyphenated.
No, "hardworking" is not hyphenated.
No. Well above is not hyphenated.
peace of mind is not hyphenated.
No, "homework" shouldn't be hyphenated.
Yes it should be hyphenated.
No they shouldn't be hyphenated.