logoalt Hacker News

jillesvangurptoday at 2:13 AM0 repliesview on HN

Safety is a great reason to not do something. Utility and enhanced safety are great reasons to override that reflex. A lot has happened since the Therac 25 incident in the medical world with AI, machine learning, robotic neuro surgery, all sorts of computer aided diagnostics, etc. This stuff undeniably saves lives. The incident did inspire some level of scrutiny of course. But compared to modern medical equipment, that machine is from the stone age.

Steer by wire (which the article highlights) is common on all modern airbus planes for decades. The first ones flew shortly after the Therac incident. Boeing has also started implementing that on their newer models. And of course most of the vtol planes/drones currently starting to operate and progress through certification programs also commonly use steer by wire. Several of these flew without pilots before their first manned test flights. These are computer controlled, pilot directed pretty much by default with that part being optional by design.

Beyond Tesla, there are now several other manufacturers implementing steer by wire in the car industry. Nio, Lexus, Toyota, Mercedes, and a few others each either already have cars on the road for this or are working on new ones. And while Tesla has received quite a bit of criticism on their FSD system, I don't think there have been a lot of incidents implicating the steer by wire in Cybertrucks. It seems to work and drivers seem to mostly like it once they get used to it. The car is controversial of course. But there's a lot of cool tech inside that is being copied across the industry now.

The implied warning "we should be careful with this stuff because Therac-25" is a bit of a cliche at this point. Yes, we need lots of checks and balances when using automation in safety critical systems. And that has been common for decades.