Reading and writing does not mean being able to listen. Listening is a separate skill. Listening skills need a lot of practice. A lot means many, many hours. 

Listen to 5 minutes of English,  write down what you hear and then compare with a transcript. Do this every day for 3 months and your English listening skills will definitely improve. 

Hi !

What is really important about listening skills is that they make you feel more confident. If you are not sure of what someone has said, it really affects your confidence.

Given your level, I would start with short dictations. Very short, just to get you to focus more. This website is very good. It has different levels too and a big choice of languages. http://www.listeningpractice.org/

Then, you could start  reading and   listening to the short texts here at http://www.listenaminute.com/

The great thing of this website is that they give you many fun exercises too and there are many, many topics to pick from.

You'll see that after some practice, a little every day, you will become more confident and you'll have improved !

I'm finding lyricstraining.com (no cost) to be very helpful to me in improving my ability to recognize words in spoken Spanish. Perhaps you would find it useful for English listening.

On this site you listen to a music video. Underneath they display the lyrics, with occasional blank spaces. You have to listen to the lyrics and fill in the blank with the correct word. There are four levels of difficulty, and you have a choice of filling in the blanks by typing or by selecting one of four choices.