alt Hacker News> I don't think you can just look at the statistics though. What I mean is that, the main issue is that the category of mistakes they make are going to be inherently different from the category of mistakes that humans make
Would you rather have a X% chance of a loved one dying from a human-category mistake? Or a 0.5X% chance of a loved one dying from a ML-category mistake? I would take the latter in a heartbeat. Why waste time optimizing for "categories" when you can optimize for your loved ones not dying
Replies
That is not the way human beings typically evaluate risks. 'Acceptable risks' are more about psychology and not a statistical calculation. A self driving car that is twice as safe as the human average would be considered an unacceptable risk.
Add something that is new/unknown + lack of control, and you will have to clear a very high threshold to be considered 'acceptably safe'. My guess is a minimum of a 0.1x.
While I agree with you, not everyone does.
You and I are thinking with a purely logical thought process, but most people don’t reason that way.
A lot of people want to be able to hold someone accountable, and that is more important than the pure probabilities.
They want to be able to blame a person for making a mistake.