Is it correct to say congrats to both of you?

"Congrats" is an abbreviation, not suitable for formal writing or polite discourse. You may say Congratulations to both of you, or -to you both.