For my part, I agree with both ;) You can end up your sentence by other terms. For instance :
"c'est vrai que nous n'avons pas mis de point à la phrase/n'avons pas parlé de ce sujet/ pas terminé de discuter à ce sujet..."
So, in fact, it's just upon the quantity. How many limits have you put at all ? If there isn't, you will add "de". And if there is, you will ask :"c'est vrai que nous avons mis une limite d'âge".
I gather that is like your term "any" in somehow way...
But the "de" is always something designing a stuff. It's the "de" of the demonstrative.