here they are talking about an affair, it is a sexual reference, I take two people, right.

It means that there is blame on both sides -- the dance, the tango, cannot happen without two people, so it is a saying to use whenever you mean that two people are involved, not just one. So, in the sample sentence you gave, the author is saying that the man has responsibility and is not just a helpless victim.