logoalt Hacker News

greenowl • today at 2:32 AM • 1 reply • view on HN

Seemed like a reasonable ask. So far, a couple people said 3x to 4x. One said 100x. Big jump. I guess it depends on your baseline coding ability before AI.


Replies

crazygringo • today at 2:56 AM

No, it's nothing to do with your baseline coding ability, and everything to do with the type of task.

If it's the kind of thing that requires a lot of iterative back-and-forth, like tweaking UX design, then there may be little speedup.

If it's the kind of thing where you there is a clear pass/fail, e.g. writing software to satisfy a comprehensive test suite that is black and white, then it could be 1000x.

The better-defined the task is and the more the agent can evaluate its own success, the bigger the multiplier.

Also, obviously, the more you are working in an area that is more unfamiliar to yourself, the bigger the multiplier.

That's why one morning I'll feel like it's maybe just 2x as it's constantly testing an app in an iOS simulator to see if a UX bug got fixed. That afternoon it might be 10x as it works on some pure code fixes that I still need to verify manually if they work. The next morning it might be something like 200x as I have an incredibly well-defined task that requires a lot of algorithmic research and 10,000 lines of code, but where the end result is easily provably correct or not. That afternoon it could be essentially "inifinity X" as it fixes a problem in a programming language I'm not even familiar with, in a domain it would take me months to get up-to-speed on, in a library I don't know, which solves a bug that is blocking me. Because it's just not something I could have realistically done at all.

So it's incredibly task-dependent. But it's pretty much always faster to some degree. Sometimes a little, sometimes a whole lot, sometimes so much faster it's still a little hard to believe.

➕ show 1 reply