logoalt Hacker News

sashank_1509today at 3:58 PM2 repliesview on HN

This is a terrible example. Cars qualitatively opened up something that humans could never do before. Same with the computer. What about LLMs?

LLMs just replace what you were already doing, but don’t qualitatively open up all that much in the frontier. A million lines of LLM slop? Arguably LLMs close the frontier, rely too much on it and your ability to think hard and long ends up getting crushed.


Replies

michaelrpeskintoday at 5:11 PM

I don't think it's as much as opening up what we _could_ do, it's opening up time so that more can be done.

Slop is too generic of a complaint. Do LLMs write code exactly how I would? No. Is my way right? Probably not. But what LLMs are great at are pre-emptively thinking about edge cases that I forget when writing the code. I'm surprised as how many fewer weird bugs come back to me now after a release. Should I have thought of them? Yes probably, but I don't and they do. So in practice, I do think LLMs write better code than me (if you look at results not the actual code itself).

But more importantly is that it allows me to take on projects that I never would have. Some of them are personal projects, some of them are work projects. I often didn't even consider a project because the time it would take _me_ to do it would not be worth the value. But now that _I_ don't have to do it, I can do more things. At the end of the workday last week, I kicked off a project that I've wanted to do for the last 5 years but could never justify writing it. The LLM crunched for 36 hours, I checked in on it this morning and it's ready for me to deploy next week when I get in the office. Something that would have taken me probably 9 months of focused effort. It would never have been worth 9 months of engineering time, but it sure is worth the 36 hours of background work while I was doing something else productive.

I guess it's not a quantum leap in the frontier of what _can_ be done, but it is a leap in what _will_ be done because the cost/benefit parameters change.

orangecattoday at 5:14 PM

Cars qualitatively opened up something that humans could never do before.

Not really, we explored almost the entire world on foot and horseback. Cars and trains "just" make it easier.

A million lines of LLM slop?

As they say, quantity has a quality all its own. Over the last few years I was working on a side project that needed a lot of tedious logic of the form "if X then Y, unless both A and B, in which case either P or Q depending on the phase of the moon". I gave Claude the problem, it independently came up with a nearly identical architecture to what I had already built, then tore through all the scenarios and produced thousands of unit tests along with validation and fuzzing scripts. The code isn't terribly elegant, and was never going to be. But it works and it's shipping, and that wouldn't have happened anytime soon without AI.