I have the same problem with Spanish.  I can understand much better when I read the words rather than listen to them being spoken.  I use youtube to listen to slow speech in conversational Spanish.

http://www.esolcourses.com/content/topics/songs/adele/someone-like-you.html

This is a very helpful page for me :)