How old ist the Tower of London?

There have been fortifications on the site of the Tower of London for around 2000 years. However, the buildings that can be seen today were started in the 11th century.