I have heard many protestants say so. In Bolivia, where I live, it is even common among both Catholics and Protestants to simply call protestants "Christians" (as if Catholics weren't Christians).
In my opinion, "Christians" would include both Protestants (diverse denominations) and Catholics.
Of course you are right; he/they shouldn't be so judgemental. (Though I don't know for sure what exactly Jimmy Swaggart said.) The general idea is a belief that "All those that don't believe like me are infidels." Which of course is exactly the attitude you should have if what you want is to pick a fight.
Jimmy Swaggart married to Frances Swaggart in 1952
The cast of Jimmy Swaggart - 1977 includes: Jimmy Swaggart as himself
Jimmy Swaggart was born on March 15, 1935
Jimmy Swaggart was born on March 15, 1935.
Jimmy Swaggart was born on March 15, 1935
Jimmy Swaggart married to Frances Swaggart in 1952
Jimmy Swaggart is not on a cult watch list.
Jimmy Swaggart is a/an Evangelist, singer, author, pastor, pianist
Yes, Jimmy Swaggart married to Frances Swaggart in 1952
Jimmy Swaggart Ministry is ran by Jimmy Swaggart.
Jimmy Swaggart is 76 years old (birthdate: March 15, 1935).
No, Jimmy Swaggart is not single.