There is no differences, these 2 words are synonyms.

Start can also be a noun whereas begin can only be used as a verb. The noun for begin is beginning.The two words have the same meaning.