I don't know what harnesses they run but when I daily tell Claude or others to do X and they indeed do parts of X and then also Y and break A on the way... I'm so tired of asking "but, really?" that I'm not even bothering anymore. The AI folks live in a different world than I live, and whether it's a real world or only in their minds (or only in their articles) I definitely cannot tell anymore. I simply gave up.
Some variation of “you’re just using it wrong” is usually the refrain I hear when I talk about things LLM’s are bad at. Anything is possible if you divine the right words to input and fix your harness and set pick the perfect model and…
Yeesh. Claude still does that? I haven't had that problem since GPT 5.