I know articles are tricky, but they're not just there to confuse language learners. They convey meaning, especially to people whose native language is English.
When someone leaves them out, it's a tiny bit disorienting. Even if the information (whether it is a specific object, how many items, etc.) is somewhere else in the sentence - that's not where I'm expecting to hear that information and it takes a few moments for me to catch up to the rest of your sentence (the parts that you think are important) while I figure out that bit of information. If we're lucky, I'll figure it out, eventually. If we're unlucky, I won't understand you at all. Leaving out articles will get in the way of your communication. And that's the whole point of learning another language, to be understood.
Also, without articles, English sounds "caveman"-like. It lacks polish.
I understand your pain - right now, I'm struggling with gendered declensions in Russian (seriously, who came up with those rules?); they're driving me crazy. But I know that if I want to be able to talk to someone and not confuse them, I need to be able to use the noun properly.