Here's a path you can take, which might improve your listening in about a year.
1) Find a book, a good teacher, or a website that explains English phonetics very well. Learn the nuts and bolts of English's sounds thoroughly. For example, do it until you can hear and pronounce "word" vs "world", "bit" vs "beat", and all such tricky sounds distinctly and comfortably.
2) Find sources of good text and audio material. Read, read, read, and read, And mix in some listening on the side, especially news casts. You do it until you can read Economist, Time, and other magazines and literary books comfortably. Once you can do this, your listening and speaking will have improved remarkably.
The rational is simple. There is no way you can readily understand something you've never seen before. The only way to listen and speak is for you to have already accumulated those vocabulary beforehand. And reading is the fastest way to absorb such a large set of vocabulary.