logoalt Hacker News

usernamed7today at 12:55 PM3 repliesview on HN

Let us hope this only accelerates the proliferation of local models


Replies

baqtoday at 1:06 PM

Serving barely useful GLM 5.2 costs what? $15k? Actually useful is like $50k? You’ll never recoup the cost unless you ‘locally’ means ‘inference provider is not the model provider’?

show 4 replies
nairboontoday at 1:06 PM

It will. Moves like this will only lead to a drift of brains and talents to tweak & tune open harnesses and open models.

forgetfreemantoday at 12:58 PM

There is the undocumented 3rd option of simply shrugging and moving on without LLMs, you know, business as usual.

show 4 replies