Have you noticed that you need to practice the language every day in order speak well?
I have not been speaking with my colleagues for 2 weeks and I've lost skill to recognizing his speech. Yes, it looks that my level of English is not high. I should be more organized and spent everyday time for writing small notice and also I need time for learning grammar.
I should not stop, like as sports sessions should be take place regularly, the same situation with language.