Another way: He is really sorry for the inconvenience that he caused me.

These can be uses interchangeably

FOR or ABOUT are equally correct. CAUSED TO ME is not a normal way of saying this. Scott's solution is good. Another option: He is really sorry for the inconvenience I suffered/experienced/had.