Can you enter the Treasury in 328 BC on Time Tangled Island?

No. You can only enter the Oracle temple.

The phonograph for Thomas Edison (1877 AD) is on the Treasury roof. Climb up the winged statue to the right side and jump to the roof.