You could imagine the complete expression in this case as: "Oh, you're reaching for an answer". The implication is that that answer is not realistic nor likely, and therefore that conclusion was not "easy to reach". It also helps to remember the expression "to reach a conclusion", which can mean to decide on an answer, or to make a decision.