Who built the first castles?

A number of different people: * The master mason * Quarrymen * Woodcutters * Smiths * Miners * Ditchers * Carters * Carpenters