logoalt Hacker News

Fr0styMatt88 • yesterday at 10:33 PM • 1 reply • view on HN

I view the thing I’m ultimately providing to an AI agent is ‘executive function’, in the sense of how it’s used when talking about ADHD; one of the core executive functions is retrieving the right skills and/or information to use, at the point of performance.

AI agents don’t have this in a sense; or they do, but it’s average and stochastic. We have to be in the loop to provide judgement and manage the agent’s context; the content of that context steers the agent in the direction that our judgement tells us the development should go, to meet the various requirements. Some of those requirements are around the software’s function, some around maintainability, some around understandability, etc.

I think scaffolding is good at decreasing the amount of repeated mistakes and ensuring the agent can request and receive information efficiently. I think software factories are too self-referential; I’m not set on that opinion though and like I’ve said in another comment, I will fall down this rabbit hole at some point just to see what it’s like.

So many times I’ve wondered “you know how to do this, so why didn’t you just do it the first time?” — the old “Oh you’re absolutely right! That’s a much better way to do it!”.

It’s not that the model doesn’t have the knowledge, it’s that it doesn’t access it at the time it is needed. Part of my job now is to collaborate with the models and the tools.


Replies

skydhash • today at 12:08 AM

From my experience there's always two parts in working with code. The deterministic part where you can derive information from the code itself and do some action, mostly used by static analysis tools (type checker, linting,...) and there's another much harder to define part like "this part of the code is unreadable and/or does not mean what the requirement says".

The first is solved by deterministic tool as code is already formal, so the grammar is very strict and fully defined. But the second part is entirely human dependent of what the end result should look like, even when the same semantics is being kept. That's why two people asked to implement the same task will code it differently even if from the point view of the machine, they're equivalent.

Maintainability and readability is not about software correctness. It's about how the human mind can absorb what the software should do, aka the specs embedded in the code, which is just formal notation. If it's easy, then the software correctness is easy to check and validate. And when the requirements changes, it's easy to apply the needed modifications.

So asking agents to improve upon that is like asking an agent to write an email. It's an alienation of human-human communication.