Except where does the accountability land?

If an individual employee does something unethical or illegal, the employee is accountable and may lose their license or face penalties, and if the company performed the right due diligence and training first then responded "correctly" when they learned of the employee's behavior, their liability might even be zero. There is case law on this topic.

But if a MODEL mis-advises or acts in an unethical or illegal way, who is accountable? The business team that spec'd and tested the solution/product? The architects and the developers? I've never met an architect or consultant with professional liability insurance.

There isn't enough tested law in this area yet.

Except instead of one defector working with one company, the same defector is working with all companies.

So not like working with people at all.

Just like would imply intent, most of us are chalking this up to the non-determinism, Ai has no intent