Where did Francis Scott Key watch the bombardment?

Francis Scott Key was onboard a Brittish ship during the bombardment of Fort McHenry. He had been sent to negotiate with the British for the release of prisoners and was held captive the entire time.