logoalt Hacker News

zozbot234 • yesterday at 8:55 PM • 1 reply • view on HN

> whether or not Ant/OAI can stay ahead of the Chinese models.

Ant/OAI/Google are way ahead when it comes to the smartest, largest-scale and most compute-intensive models. By Jevons' paradox, if you make inference for leaner models cheaper (as the Chinese models do, being broadly comparable to GPT Terra or Claude Sonnet; barely approaching Opus/Sol at their very best) that only increases demand for the complementary service of very smart inference.


Replies

anonzzzies • today at 3:00 AM

Sure but routing simpler things to the open models and harder things to opus/astra gave us already a massive boost; rarely we run out of tokens on the subscription models and we recently cancelled a few seats on claude code / codex as we simply were underutilising. And also, we have users of our products ONLY using the cheap models as they benefit enough vs paying more. That was very different only months ago. I can see this gap just growing where the % of higher intelligent model use will get smaller and smaller.