It's acceptable to use either choice, there is no clear rule, but "start" is used more often and in most informal contexts.
You would also usually "begin" a structured task such as a test, a meal, a phonecall, a race, and anything else which happens in a limited time and is completed soon.