No. If you called a dairy farm just "dairy," it may not refer to specifically the dairy farm itself, but to something else entirely. There are many things that have the term dairy attached to it, from cows to barns the industry itself.
Another Answer:
A dairy farm is commonly know as a dairy in today's society, But many people still refer to a dairy as a dairy farms to make it simpler to understand.