Except where does the accountability land?
If an individual employee does something unethical or illegal, the employee is accountable and may lose their license or face penalties, and if the company performed the right due diligence and training first then responded "correctly" when they learned of the employee's behavior, their liability might even be zero. There is case law on this topic.
But if a MODEL mis-advises or acts in an unethical or illegal way, who is accountable? The business team that spec'd and tested the solution/product? The architects and the developers? I've never met an architect or consultant with professional liability insurance.
There isn't enough tested law in this area yet.
It might not be tested. But, it would seem very weird if anyone other than the person using the LLM was accountable for the output.