You don’t need to be a hacker to do this. My elderly neighbor searched for some version of “Microsoft help center phone number,” but Gemini suggested a scam number based on her search terms. She was scammed so much that I needed to spent the weekend helping her wipe computers, lock down the digital accounts and deal with identity theft.
My wife runs the Facebook page for our community pool. It's a really nature oriented community, and as a April Fools joke, she posted something like "Announcing our new landscaping: we cut down all the pesky sun blocking trees, and replaced the grass with beautiful AstroTurf."
A few weeks later she searched for the pool on Google, and the AI review has taken the post seriously and mentioned that our pool features beautiful AstroTurf landscaping.
IIRC, the AI review repaired itself a few weeks later.