Do you mean the actual glass itself is warm or the water inside?
If the water is warm then its a glass of warm water What is the
noun you want to modify -- the glass or the water? It's hard to
imagine a warm glass containing cold water, but I suppose it's
possible.