logoalt Hacker News

yieldcrv • today at 4:37 PM • 0 replies • view on HN

I disagree, I think local is the supercycle here once it gets out of enthusiast territory

We have LLMs baked directly into silicon getting 20,000 tokens/sec with low power consumption, Taalas was bought by AMD weeks after that demo. In that world, people get a new LLM only on hardware refreshes, and only after LLMs are good enough to be in stasis for years

Apple’s M7 Pro/Max if it meets promised will be very expensive, I see some enterprises rolling them out to some staff

Some language models in the Apple Ecosystem are already baked into iOS and MacOS, and its ubiquity is invisible

Thats the direction I see things going, but like not anytime soon to alleviate supply chain crunch. 2029, 2032