logoalt Hacker News

simonwtoday at 1:54 PM4 repliesview on HN

I'm not completely convinced by this comparison between blind chess and prompting LLMs.

In blind chess you get deterministic information about the state of the board: each mental update to your board model can be precise, and you have the full state at every point in time.

LLMs are notoriously non-deterministic, and even at temperature zero you still can't predict exactly where the weights will take you next.

I suppose you can get closer to deterministic if you adopt a prompting style where you almost dictate every line of code, but at that point the coding agent is more of a typing assistant.

The productivity benefits of coding agents unlock themselves when you figure out how to turn short prompts - "add tests that exercise the registration form and check the happy path and all failure states" - into larger changes.

If you're completely blind to the results of those you're going to end up with a system you don't 100% understand very quickly. In blind chess terms you'll no longer know the positions of every piece on the board.


Replies

andaitoday at 3:22 PM

>you're going to end up with a system you don't 100% understand very quickly

This has been my experience with all software projects. Even if I wrote all the code, my understanding of how everything works and fits together decays.

( See the Forgetting Curves https://en.wikipedia.org/wiki/Hermann_Ebbinghaus )

show 1 reply
NameErrortoday at 2:03 PM

I agree with your take, particularly because of this line in the article:

| the skills that define a strong blindfold chess player are the same as those of a programmer who can thrive behind a Claude Code terminal whilst not reading nor writing any code.

If you're actually not reviewing the outputs, you're just getting a fuzzy description of the state of the chessboard.

But I (and everyone I work with) use Claude Code in a workflow where I -do- review the outputs, or at least I make an honest effort to try. Rather than blindfolded, I think bullet (1-minute) chess is a fairly good analogy for this: you have all the info you need to keep your mental model up to date with reality, but the pace of change is too fast to do a good job unless you have a lot of preexisting chess expertise.

show 1 reply
vunderbatoday at 2:17 PM

IMHO the thrust of the article feels a bit forced, but LLM = Blindfold chess is not what the author is saying:

> Thus in many ways programming with AI is the opposite of blindfold chess: you don't have to pay attention every turn, you don't have to remember what the important pieces are, the details of the tactical relationships (such as code interfaces and APIs).

show 1 reply
trollbridgetoday at 2:27 PM

  LLMs are notoriously non-deterministic, and even at temperature zero you still can't predict exactly where the weights will take you next.
An LLM can be made to be completely deterministic. I use them in this mode so I can reproduce test cases. Of course it requires complete control over the model, etc. but this myth that a computer program is non-deterministic needs to end.

You can 100% predict where the weights “will take you” given a set of inputs.

show 6 replies