Well, you see it as a normal friendship, right?
What about the guy? Maybe he thinks otherwise?
Perhaps, you can say that his wife is just being paranoid, but that's pretty normal.
Maybe, it is not the friendship that is weak, it's the mind of the persons involved (not including you I guess).