Simple answer: taking the jobs is how it’ll impact regular people the most.
We already have personalized, algorithmic advertising and what I would call “control” all over the place: things like consolidated oligarch-owned media.
AI isn’t going to change how we are advertised to or controlled all that much, at least compared to the prospect of being put out of work or taking a huge salary cut similar to the mid-century worker who used to have a $40/hour union factory job and now works at Walmart below health insurance threshold for $15/hour.
Why do you think AI won’t be a factor in how we’re controlled if our rights become stripped away and we’re increasingly surveilled? Or if violence is deployed by the state against its people with broader targeting? You seem to take for granted that nothing will change except maybe the flavor of rhetoric.
Hyperinflation is how it will impact most people. You will still have your job, at your pay, but a continually higher percentage of earnings will go to very few at the top.