logoalt Hacker News

SOLAR_FIELDS • today at 6:55 PM • 3 replies • view on HN

They (OpenAI models) are very tuned to be depth first and you can coach them all you want to try to be breadth first but as that context window fills up on those long running tasks they drift back to their first principles, which means obsessively testing and verifying a singular task rather than proceeding to the next task on the list


Replies

nsingh2 • today at 7:28 PM

I wonder if that depth-first/rabbit-holing tendency is why GPT models tend to be better at mathematics (my own experience) than code.

➕ show 1 reply
quotemstr • today at 7:06 PM

If you're using a sufficiently flexible harness (perhaps your own) you can make conversations as branchy as you want.

sandos • today at 7:35 PM

This explains why I like GPT: I LIKE for them to excessively test each step, kthx!