Guinea pigs are usually considered pets. Vermin is usually an animal that ends up in what us humans think of as "the wrong Place", or in too big numbers. Mice, living in the wild aren't vermin. When they raid the pantry in a cabin they become vermin. Guinea pigs could become vermin, if they were to go feral someplace and breed to a large population.