Are there past tense words that start with A?

Yes. Examples: aged, aggravated, afforded, approached, allowed, amassed, and many, many more.

Any verb that begins with A has a past tense form.