logoalt Hacker News

n_u • today at 7:34 PM • 4 replies • view on HN

Why do you think rolling out faster -> more inference savings?


Replies

jychang • today at 9:52 PM

Here's an explaination of what's going on in the backend.

Alibaba is forced to do this stuff: https://www.tomshardware.com/tech-industry/semiconductors/al...

Meanwhile Deepseek: https://news.ycombinator.com/item?id=45643163#45652636

rpdillon • today at 7:37 PM

If one of the dimensions it improves upon is inference cost per unit of work, then switching over to it would save money, and the sooner you do that, the more you save.

➕ show 1 reply
xeshuman • today at 7:36 PM

Smaller model, likely.

WASDx • today at 7:37 PM

If it's more efficient than 3.8 that it replaces.