It's a formal phrase: you're going to follow up with a moral or intellectual argument, or give the scoundrel a good lecturing. So give it your richest and most educated tone! Even when you are furiously angry. ^^

modest & polite, not be rude