logoalt Hacker News

buildbottoday at 6:48 AM6 repliesview on HN

I’ve observed exactly these patterns with Opus and Fable as well - for example, forgetting that they can edit files and instead use python scripts as a patching tool…


Replies

nvchtoday at 7:38 AM

The harness instructs them to behave this way. Also this approach saves tokens. The scripts allow to edit files in bulk, and most of the session cost is in cache reads (e.g. for 300K context each command costs the same as 30K input tokens).

show 3 replies
jaapztoday at 6:52 AM

Why would you use a constrained edit tool when you are also allowed to use the complete power of python?

show 5 replies
whstltoday at 7:36 AM

This is an instruction by the harness. It re-injects the prompt every other message, so that's why it "forgets" to use the Edit tool.

llama-for3vertoday at 7:03 AM

this is intentional, afaik agents do better with python and alike than the harness tooling.

show 1 reply
ZeWakatoday at 8:11 AM

I use AST replacers, much more reliable.

d5lt5today at 6:56 AM

Sounds like you don't have enough experience with coding agents. Deterministic scripts must always be preferred instead of LLM tool calls. In fact, you should instruct your agents to write code to execute instead of letting them call tools.

show 2 replies