Is adultery crime?

Yes, adultry is a crime in some states. States such as Alabama, Colorado, Florida, Georgia, Massachusetts, Michigan, North Dakota, and Oklahoma still have criminal statutes outlawing adultery.
However, most states today have either abolished these statutes against adultery or will not prosecute people for this crime. http://www.legalmatch.com/law-library/article/adultery-lawyers.html