There’s been infinitely times where I was stuck at some problem and every single solution was complex, messy, over-engineered and somehow wrong, until I went on a walk or moved to a different issue and suddenly it would hit me that I was looking at it all wrong, and there’s a simple solution there but my tunnel vision didn’t let me see it. LLM rob you of that, everything is instant, there’s no time to reflect, there’s no time to realise it’s a dead end, or that it won’t work with the next problem on your todo list.
I recognize this, LLMs never stop, they pursue the dead end at all costs.
That's a choice (unless your management thinks otherwise). I don't need my agents running non stop. I tell them to start running once my walk is completed and I have a clear vision of what I want them to do.
I would say that the mechanism for this is actually due to the nature of working with LLMs: they free your attention.
Say you're working on a project, and it does an ok job like what the GP says. Each step looks fine, but put together it looks off. You give it some instructions, and then you let it work.
But what are you doing in the freed up time? You context switch into another project and give that some instructions.
Now you have two or three or ten projects that superficially look fine, but you yourself have context switched so much you don't have the overview anymore of why exactly each project needs fixing.