The OP writes:
*Or am I too serious on this and are these two terms very much interchangeable?
Yes, you are :D As an American, it really doesn’t matter, although the distinction Sam makes is accurate. In fact, we’ll often say “the pantry”, even though most houses don’t have a real “pantry” these days. In real life, it's not clear when we would even need to use these words (other than when purchasing cupboards / cabinets). If a guest wants something from the kitchen, I’ll go get it for them, or if they really insist on self-service, they don’t need me to tell them the potato chips are in the cabinet as opposed to the refrigerator. Or do they…?