logoalt Hacker News

cyanydeezyesterday at 6:17 PM1 replyview on HN

Theyre training the system to minimize compute,so most likely theyre dynamically downgrading quants in the first few turns hoping to find the cheapest model to run. The side effect may be excessive token gen


Replies

daishi55yesterday at 6:28 PM

Sure. That’s possible. But that’s not what I was talking about.

show 1 reply