Does a fire extinguisher on a boat need to be coast guard approved?

Yes, if the boat is under coast guard jurisdiction, or some other place that has adopted coast-guard regulations for fire extinguishers, then any REQUIRED fire extinguisher aboard must be coast-guard approved and labelled accordingly.