We’re going to learn a painful lesson
AI isn’t responsible. People are responsible.
It doesn’t matter if it’s code, writing, or military decisions. People can / should be held accountable. As soon as people choose to remove their own accountability, that’s when the bad stuff happens. Whether it’s slop code or innocent civilians killed in a missile strike
It seems that a pretty clear first step is that thinking traces are required, along with sourcing all evidence, so that things can be easily double checked. Anthropic/OpenAI have business reasons for not sharing those, but it also probably means they can't be trusted with any vital decision making.
This is absolutely the case. Sometime the person responsible will be the person using the AI, sometimes the people responsible will be the people who created that AI, but actual humans must always be accountable when AI is used to cause harm
People will not be held responsible; the disasters caused by AI will be attributed as a natural phenomenon -- like the weather. The companies involved in creating and operating AI will certainly not take any accountability for any "spills".
New take on an old adage: "A computer can not be held responsible. Therefore a computer should always be used to make management decisions so that we can cover our asses."