I'd wager it's more due to decision making culpability.
Now, for the next "teen committed suicide after talking to AI therapist" headline, Claude can deflect the blame to the parents for not supervising their child enough.
If you have an ineffective system for preventing a thing from happening, but one where the "victim" has to override the system, the victim is at fault.
Your honor, the user manual in the box did say "don't put children in the microwave."
If you have an ineffective system for preventing a thing from happening, but one where the "victim" has to override the system, the victim is at fault.
Your honor, the user manual in the box did say "don't put children in the microwave."