I was very enthusiastic about Matrix a few years ago, but my experience has been relatively bad and I lost interest.
Apart from the experience, I think that there is a fundamental issue in the way Matrix is built: the Matrix servers have access to a lot of metadata (at least last time I checked, but it feels quite fundamental to the protocol).