It could mean either, depending on the context.

Since 'Paternal' means related to being or characteristic of a father I suppose it could have both meanings but I would prefer the pleasure enjoyed by the father rather than the other way because what is 'paternal pleasure got from the father'? I don't think the concept exists. Parents give their children love (paternal/maternal love) affection (paternal/maternal affection) etc. But pleasure?