Yes, Chinese is a remarkably difficult language to learn.
I have not however attempted to formally learn Chinese at any point, but given that Mandarin is the principle language spoken in my home, it was innevitable that I would come to grips with it to some degree.
I am at a point now where I understand many words that I over-hear in conversations, and in some cases I can understand the complete gist of the conversation. I also have many Chinese patients and I even surprise myself sometimes as to the extent of what I understand, when they speak Manadrin in front of me.
But it still a remarkably difficult language, especially given that I don't "hear" many of the nuances of tone that is part and parcel of Chinese.
Just like many Chinese not being able to hear the letter "R", I too am tone deaf when it comes to many pronunciations in Chinese.
Recently I have been speaking more and more often to my son in Mandarin. This has been my playful way of practising my Chinese.
My son always corrects me, and laughs in the process.
Only yesterday he said: "Daddy, your Chinese is so funny.You have an English accent when you speak Chinese."
He would then try and help me to pronounce the word properly. He is such a cute little boy.