This sentence is somewhat colloquial, and probably more acceptable in American English. British English speakers would be more likely to say 'I have always done the right thing by you'. Or you could turn that around and say "I have never wronged you', although that is slightly literary and not common in every day speech.