It looks inevitable to me. Technological ability ushers in the new social realities. The industrial revolution turned around how we live, intelligence on tap being able to interpret everything in real time is indeed leading down to the total surveillance state direction. I don't see anything that may stop it. You will have to run constant real-time surveillance systems on all your devices and anything that doesn't run those will be illegal, with secureboot on steroids. Due to the convenience benefits, people will willingly give access to cloud-based AI services to all their information, all their plans and documents and calendar and email and everything. And you blink twice and it all becomes mandatory, and you will be an extremist if you don't want that, because why would you have anything to hide? "Just follow the law, follow the rules, and you'll be fine", that will be the slogan.

Stories like this article have zero effect on normal people. They see a crime being prevented, which is good. You have to bring a story where a sympathetic character is getting the short end of the stick somehow.

You would still be able to not write everything into a LLM? But yea the surveillance aspect is dystopian. I would not be surprised if Facebook, twitter and co already know a lot but have simply not reported it. Now the LLM follows the rules.