The reason why Chinese is perceived as a difficult language is due to its history.
Cantonese Chinese is the original form of Chinese language. However there is no such thing as "Chinese".
There is either Cantonese or Mandarin Chinese. Mandarin Chinese is the language for masses and it is far much easier to learn as compared to the traditional Cantonese Chinese.