It is rare to be able to remove all of the residue. Try using goo gone on a small corner of the shirt and see if it messes up the material if it doesn't gently apply it to the glue. Sometimes soaking and gently rolling fingers over the glue will remove the stickiness as well.
You could try burning it off with an iron, other than that, you can't.