Can you get sick from eating a moldy olive?

No. mold on vegetables is actually not bad for you. If you ate meat that has mold on it you would get a bit ill but not on a olive.

P.S

There is actually a mold they have proven that is one of the best antibiotics in the medical system.