logoalt Hacker News

jvanderbottoday at 7:02 PM2 repliesview on HN

A better statement might be:

    Current agentic systems may be *built* from next-token predictors which are conceptually simple, but because of agentic frameworks, recursive invocation, tool use, and *heavy* investment in reinforcement learning in these contexts and for specific applications, they can no longer be thought of as "Merely" next token predictors.
Modern agentic work is probably more of a "emergent system from simple rules and complex interactions" paradigm than a genuinely new technology.

Replies

whateveraccttoday at 9:55 PM

the next token part is like the "clock" that drives it

danielmarkbrucetoday at 7:55 PM

Nope. Post training means even the raw model isn't predicting.

show 1 reply