logoalt Hacker News

ImaCaketoday at 4:06 AM4 repliesview on HN

Or what if local models get good enough to threaten the server based product?


Replies

edf13today at 8:04 AM

That is the biggest threat - and likely where things will end up eventually… it’s when that “eventually” is and what the server based providers can pivot to in that time.

mikkupikkutoday at 9:26 AM

This will probably happen unless the industry conspires to roll back the availability of general computation so common people can only own computers with enough power to be glorified thin clients. The way this might look is good hardware never officially being banned, just priced too high for anybody to afford, and produced in small quantities to keep it that way while all production shifts to making massively expensive powerful hardware for corporate buyers.

nosefurhairdotoday at 8:25 AM

Seems unlikely. We're already seeing specialized hardware optimized for LLM performance (taalas, groq, cerebras), and simple economies of scale result in these sorts of products being a better value when rented from a server vs purchased/managed/upgraded for the typical the user.

Frontier models will continue to be either exclusively available from servers or significantly more affordable from servers vs local alternatives for the foreseeable future.

otabdeveloper4today at 6:55 AM

They're good enough already.

The moat is only

a) post-training magic for the elusive UX "vibes"

b) stickiness of the Claude UI's.

The first part will be eventually (give it a couple years) solved by a LoRA marketplace.

The second is not relevant because existing UI's are very sticky already and Claude won't be able to overcome decades of inertia anyways.

show 1 reply