logoalt Hacker News

layoric • today at 5:06 AM • 1 reply • view on HN

IMO then it is missing the forest for the trees regarding open weight models. Qwen 3.8 Flash Next or 27B, for example, are accessible enough to run at home/office at very usable speeds. Provided memory companies don't collude to keep margins at 80-90% they are at the moment, it seems to me this will become a lot more accessible for many use cases while models at this size still have room to improve.


Replies

jimbokun • today at 5:26 AM

Except it’s very difficult for home users to afford the GPUs needed to run them with acceptable performance.

➕ show 1 reply