The problem with past perfect with 'promise', is what is the implied second event, if you don't mention one?
Usually it is not a consequence. Unless you specify it, It is usually a negation!
I had promised him I would go (BUT, I was lying, and didn't)
Use simple past, unless you want to introduce doubt, or explicitly specify the second event.
I had promised him I would go, and I had to ask a special favour of my boss to get there.