Does the word 'there' take a singular verb?

Sometimes yes, sometimes no. It depends on the number (singular or plural) of the subject.

Examples:

There goes the bus.

There go the buses.