I believe there is a second meaning. When two people are engaged in conversation, "I won't keep you any longer" is a polite way to signal the end of the conversation.

I will not keep you waiting