What physical geographic factors made building the Panama Canal difficult?

The location of the canal made it difficult to build because of its distance from the countries buliding it.