Well, the challenges change depending on your level in a language. I find that speaking is the hardest part when you just started a new language. When you are an advanced learner, instead, the biggest challenge becomes what to study, in my opinion. After you have taken the classes, read the books and you are good but not as good as you can be and there is no "ready-made recipe" on how to improve.