Do you capitalize the first letter of both words the closing of a friendly letter?

No. You only capitalize the first letter of the first word in a closing. E.g, "Sincerely yours,"