Yes. He doesn't want to continue the conversation, so he's getting out of the elevator and walking the rest of the way up to his office.

Ha ha. Mr. B misjudges the floor just as he misjudged the age of Mr. A's wife.

He's prefer to walk 14 floors than keep talking.