Do you have the full sentence?
His being involved is similar to saying his involvement but there is an emphasis on the fact that he is involved. It is a stronger way of saying his involvement.
It is often used in accusatory speeches like, "What with you being involved!" It is just much stronger than, "Since you're involved!" It is like prolonging the expression into "Since there is the matter of you being involved."