For me the danger of AI is that it enables the surveillance state through facial recognition and the instantaneous aggregation of all my data. For "national security" reasons, I may be detained and denied of my rights if Palantir hallucinates. Who do I sue if Palantir decides I am an illegal?
Ot worse because it didn't hallucinate, and they are coming for you, as a free thinking "radical". They can tell from a long deleted blog post you made in 2005 about green energy.
Human law enforcement hallucinates all the time. This is a bit like a poor argument against self driving.
Another danger I see is job loss. Who wants a world where the wealthy control AI and completely destroy the middle class.
The thing is a government never needed technology to be authoritarian. The government today already has all the tools to ruin your life. It had them in 1940. It had them in 1840 and it had them in the year 40 as well. And that tool is known as the monopoly on violence. It can be wielded in many ways good and bad.