A balistraria is a narrow opening, often of a cross shape, through which arrows can be fired.
Perhaps an arrowslit or "balistraria" Or maybe you should put your character on top of the castle walls so you can talk about the battlements or "crenellations".
The slits are simply called arrow slits or occasionally Balistraria. Sometimes the arrow slits are looking out of embrasures. Arrow slits were useful for protecting the castle as they were easy to fire out of but very, very hard to fire into. To find out more about embrasures click on the link below. "Wikipedia.org: Embrasure" To find out more about arrow slits click on the other link below. "Wikipedia.org: Arrow slits".