There is only a slight difference, in the second he is answering your question. In the first "answer" has a numbr of meanings
1) He answers the phone, he picks it up and says hello
2) He answers, which could be a wave or a grunt
3) He answers you, which might not be focused on your question but a distraction
4) He answers your question.
So the second is more specific