How do you do 5 12 12 in pythagorean triples formula?

You can't. 5, 12, 12 is not a Pythagorean triplet. Instead 5, 12, 13 is a triplet.

As such: 5^2 + 12^2 = 13^2

25 + 144 = 169

169 = 169