What is the signifance of the mean of a probability distribution?

It is the average of all the numbers in the distribution. If you chose a random data point of the distribution, there would be a 50% chance that it is above the mean, and a 50% chance that it is below the mean.