Can you still get pregnant if you didn't have intercourse but his sperm got on his hands and then he fingered you?

Yes, it only takes a single sperm to get one pregnant. It is not real likely, but it is certainly possible.