There is a little water in the glass is it empty?

No.
As long as it has something in it other than air, it isn't empty.
However, referring to an eight of an inch of water in a glass as empty when asked to pour someone some water is valid.