alt Hacker NewsBitter lesson means all these tricks will not be needed in a year or two. Either labs will abstract it in harness or models will become good enough that it can do it by itself
Replies
I disagree. Parallelization, coordination shouldn't be model-level functionality. Further, how do you know if or when we'll get orders of magnitude increases in context sizes. Or, do you mean that the labs will just nail the perfect plug-and-play harness? That's fair, but why wait.
Models are already good enough. Last week I had Fable plan out a project that took approx 4 days end to end with each phase orchestrated by a supervisor agent delegating individual tasks to other agents, coordinating everything and checking status by simple text files in the repo. I didn’t have to tell the agent to do it that way, it just came up with it and set up the infra as part of the planning overview. Great that everyone’s posting their “my secret sauce” cookbooks just to jump on the hype train but it looks like the models have already figured it out for themselves.
If implemented correctly these tricks will still work on less expensive models delivering nearly identical value.
Today, a hefty amount of standard coding tasks can be completed with similar results to gpt astra using terra and a tailored harness around it.
Also the scale matters. One big, expensive session, with a frontier model paired with a dev-babysitter is ok. But make it a factory (kindergarden: few devs, many parallel streams) and you'll want to follow a strict protocol.