B is likely to be right as the most natural response. The other person logically reasons that it is likely that he didn't go.
C makes sense but is a non sequitur. The first person said only that he or she didn't see him, not that he definitely didn't go.