Yes! You could also say: He started being distant with/toward(s) me. 'Start' can be followed by a 'to' verb or an 'ing' verb. For me, the 'ing' version sounds more native here.

They are all fine. Toward is more US English

Only thing I'd change is instead of "toward me" it will be "towards me."

All these sentences are correct. :)