"Yes, man!" is an English equivalent of the Jamaican phrase Ya mon!
Specifically, the adverbs "yes" and ya have the same affirmative meaning in English and Jamaican English. The noun "man" and mon also mean the same. The difference really relates to the lilting pronunciation characteristic of Jamaican English.