alt Hacker NewsI don't think that's accurate. Until recently the code we rely on wasn't blindly trusted. People wrote and QA'd it. We may not have reviewed it personally, but that's one of the functions we outsource to software maintainers or "manufacturers".
I'm not "blindly trusting" code on my computing devices. I'm trusting the vendors / maintainers to do their job.
Until very recently the norm has been that the vast majority of code had human eyes and hands on it.
Edit:
The owners of those human eyes and hands had some type of accountability (either reputationally, in the case of free/open-source software, or occupationally, in the case of proprietary software).
The LLM has no accountability as to the output it generates.
The companies who make the LLMs also seem to have very little accountability, too. We've assumed a "blame the victim" stance when people use LLM-generated output in some inappropriate ways (legal briefs with "hallucinated" citations, articles "written" by LLMs). Whether that's the right location for accountability to be placed isn't for me to say, but that seems to be how it is.
I'm not sure that we're applying accountability to LLM-generated code in the same way we are for, say, the LLM-generated legal brief.
Replies
> Until very recently the norm has been that the vast majority of code had human eyes and hands on it.
What quality does it have that humans had eyes on code?
Elite teams likely still produce code of better quality with a higher qa bar than agentic code. But that category is dimishing everyday.
The core point is that so much trust is reduced to "Joe in cubicle". Also a lot more than what he can carry.
Most of the code that is being executed on your behalf is far from written by elite teams.
A compiler is not an LLM, and I do not want to equivocate, but there are aspects of similarity. We do not assume people read the bytes of machine code to ensure it’s correct — there could be mistakes. We also write and run automated tests to ensure the code outputted from a compiler and an LLM behaves correctly. At some point, we won’t have to literally read every byte of code that comes out because we have a reasonable assurance that it’s correct.