An aspect of AI that's really underdiscussed is just the basic switch from doing all your searches logged out to now being forced to be logged in somewhere. That much alone is disqualifying for me.
You can use an offline model via ollama. I'm sure better tools will emerge for less technically-inclined individuals.
Seems like there might be demand for chat clients with end-to-end encryption.
Just because you're not logged in doesn't mean that your searches aren't being stored and monitored nor that they can't be subpoenaed. It is possible to be pretty anonymous on the internet, but it's not easy.