What does the word le fay mean?

It is the anglicized form of French "la fée", meaning "the fairy".
It seems strange that English speakers would add this pseudo French epithet to the name of the fairy "Morgan le Fay", especially since it is not even grammatically correct, it should be the feminine "la" instead of masculine "le", but until someone invents a time machine, we'll never know why.