> I don't see the problem. Ai doesn't need to get it all right, first time.
Yes it kind of does or it’s not what we were promised/sold. A tool has to work reliably. I don’t want a calculator that’s correct most of the time.
> Yes it kind of does or it’s not what we were promised/sold.
No one ever promised this, and in fact, quite the opposite.
> A tool has to work reliably
They work reliably for what they do. You make a request and it returns text. What you _do_ with that text is a question of engineering and process. That are plenty of unreliable steps in business and industrial processes that people _engineer around_. A huge amount of computer chips are just _thrown away_ because of reliability problems in the factories that make them, for example.
> I don’t want a calculator that’s correct most of the time.
An LLM is not a calculator and if you're trying to use it for that, that is a you problem.
So we can add a harness around it? We have decades of experience how to work with faulty sensors, etc… multi-voting, sampling, etc. This will become a part of the harness soon enough . I mean - we can want it to be perfect - sure - but we can deal with imperfect.