Are guinea pigs from New Guinea?

No. They originated in the area of Bolivia, Ecuador and Peru in South America.

There are a large number of theories on why they came to be known as "Guinea Pigs", one being that their Latin name gave rise to confusion about them being "pigs" and that "Guinea" may be a European corruption of Guiana.