Chinese gets a lot easier once you reach an elementary level, but getting past the initial hurdle of tones, pinyin, and all those characters.....it’s a lot to wrap your head around as a beginner. Even though the rules aren’t necessarily any more complicated than any other language, a lot of them are very different, and Chinese pronunciation is relatively unforgiving of mistakes.
As an advanced learner, the big difference in written and spoken Chinese, the presence of remnants from Classical Chinese in modern idioms, poetry, and fiction are all big challenges.