They are talking about a duel, I think. In a duel, each dueller has a 'second' - that is a person that acts as their supporter. Since a duel involves a dispute that is 'worth dying for', it is unlikely that the duellers would be talking to each other - hence why he is talking to his opponent's second.