your english prases seem to be thought in portuguese :)... It's more usual to say simply "You let me down", even if it is not literally what you mean...but it is more usual...i guess...
but i also think that "You abused my trust" would be more correct...