He lost track of the point that he was trying to make. It is the same as losing his train of thought. "Miss the point" is different. "You missed the point" means "you did not understand the point of what I was saying", in other words "you did not understand".