Does it cost to go to a Holocaust museum?

That varies from museum to museum. Look at the website of any museum you are interested in visiting.