You can join the CIA without military experience but the Special
Activities Division is a highly trained division, most of the SAD
agents are recruited from Army Delta or Navy SEALs, so it's very
unlikely, I am not saying that is impossible just because there
isn't much information about the recruiting process, but I can't
imagine a inexperienced person fighting alongside these high
skilled soldiers, if there is any position for non military is
probably in supporting position like intelligence analyst.