Is alarmed an adjective?

It can be, and may also be a verb. It is the past participle of the verb "to alarm" (to upset, worry, or excite).