It depends on the context that you use it in. Though it is a common military expression it is also used a lot in customer service when addressing a male customer, or to an older male to show respect. It is not used among friends or peers and generally not used among relatives, unless you are not close to them.
My father asks people not to call him "sir" because he says that it makes him feel old.
So, if you said "sir" to a friend, or to someone around the same age as you, his response may have been "wow" because he was not expecting it or you may have said it in the wrong situation socially.
I hope that helps. :)
One more thing... not really related.. when I was abroad in Asia I had sales people call me "sir" on accident. At first this surprised me because I am a female and the proper address would be "miss" or even "ma'am". I understand now that they were just trying to be polite but did not understand that "sir" was for males and cannot be used for females. In this situation a may have responded with a "wow."