What is the only state that has a border with Canada and the Atlantic ocean?

The only state that borders Canada and the Atlantic Ocean directly is New York.

(because Long Island extends into the Atlantic Ocean proper)

Maine and New Hampshire also border Canada and have an Atlantic coast, but the body of water that they border is the Gulf of Maine, an arm of the Atlantic Ocean.