> And they do it as part of ReAct loops. If the tool fails to run, code assistants can troubleshoot problems on the fly and adapt how to call then tool until they reach the goal.

Yeah, but fundamentally all of this is implemented as next token prediction, given the context (which the tool results are).

Honestly, it's pretty amazing how much we can do with next token prediction, but that's essentially all that's happening here.