Hi Rrooxx!
"He went (=he left?), biting his fingers in anger."
The second clause is descriptive, so I don't think it needs the full-sentence treatment.
"Bite"->"biting". This keeps the long vowel; "bitting" indicates a short vowel... and isn't a recognised word anyway. ;)
If anger causes you to act a certain way, it's done "in anger".