Can you play Club Penguin on a PSP?

No. You can only play Club Penguin online or on Club Penguin Elite Penguin Force for the Nintendo DS.