Do you need an acting agent if you want to audition for a voice over gig?

No, you do not need an agent. Oftentimes you cannot get an agent if you don't have any work to show first. So, get some work on your own and then look for an agent. Even if you have to do some freebies.