logoalt Hacker News

amangsinghtoday at 12:19 PM3 repliesview on HN

Herding cats is treating the LLM's context window as your state machine. You're constantly prompt-engineering it to remember the rules, hoping it doesn't hallucinate or silently drop constraints over a long session.

System-level governance means the LLM is completely stripped of orchestration rights. It becomes a stateless, untrusted function. The state lives in a rigid, external database (like SQLite). The database dictates the workflow, hands the LLM a highly constrained task, and runs external validation on the output before the state is ever allowed to advance. The LLM cannot unilaterally decide a task is done.

I got so frustrated with the former while working on a complex project that I paused it to build a CLI to enforce the latter. Planning to drop a Show HN for it later today, actually.


Replies

skeledrewtoday at 3:24 PM

> The database dictates the workflow, hands the LLM a highly constrained task, and runs external validation on the output before the state is ever allowed to advance.

This sounds like where lat.md[0] is headed. Only thing is it doesn't do task constraint. Generally I find the path these tools are taking interesting.

[0] https://github.com/1st1/lat.md

mywacadaytoday at 1:17 PM

I started that very personal project on Monday, waiting with baited breath, make sure to add a sponsor me a coffee link.

show 1 reply
fallinditchtoday at 12:39 PM

Sounds good, I'll keep an eye out.

show 1 reply