If a humam published an article claiming this exact same thing as gemeni, the author could be sued and have a pretty good case.

But when gemeni does it its a "mistake by the algorithm". AI is a used as responsibility diversion machine.

This is a rather harmless example. But what about dangerous medical advice? What about openly false advertising? What about tax evasion? If an AI does it is it okay because nobody is responsibile?

If applying a proper chain of liability on ai output makes some uses of AI impossible; so be it.