Why does atmospheric pressure change as you go up in altitude?

Atmospheric pressure is basically the weight of the column of air above you, go higher and the column is shorter resulting in less weight over the same area (lower pressure)