Is it pleasure of inviting you or pleasure in inviting you?

Either phrase can be correct, as long as the rest of the sentence agrees with it; e.g. '(have/had) the pleasure of..' or 'take pleasure in..'.