alt Hacker NewsThey’d be in an easier position if they built the system such that it was impossible for them to know what people are writing. They might catch a little flack from people who want them to surveil all their customers, but by and large people seem to accept “we take technological measures to ensure privacy and that means we can’t spot crimes.”
So this conundrum is at least partly of their own making.
> They’d be in an easier position if they built the system such that it was impossible for them to know what people are writing. They might catch a little flack from people who want them to surveil all their customers
The companies making these AI chat bots are the people who most want to surveil all their customers. The plan is (or will end up being): spy on what their customers are saying to their chatbots, use the conversations to further train/improve the AI and to increase the user's engagement with it, mine the conversations for every scrap of private/personal data and build dossiers on the customers, let other companies and governments pay them for that data or at least turn the chatbot into a shill/manipulator targeting customers based on the contents of their dossier, then use the contents of their customers dossiers for anything else they want.
If they actually set up their services to be private it would kill almost all of the expected value and also cut them off from their best remaining source of training data that isn't the AI generated slop their products are increasingly polluting the internet and the rest of media with.