What group of people were haters of African-Americans?

the KKK (Ku Klux Klan) and some normal southerners.