alt Hacker Newsantirez running (quantized) DeepSeek V4 Pro on a Mac Studio M3 Ultra with 512GB of RAM:
https://bsky.app/profile/antirez.bsky.social/post/3mlzwmvlov...
It's much closer than you think. We're going to see specialized hardware in the next 24 months capable of running 2025-era frontier models. That's big.
Replies
dist-epoch • today at 2:16 PM
That specialized hardware will be scooped up by AI data-centers, just like RAM is today.
➕ show 2 replies
It's big because it may take a big swath of people who will actually pay for LLMs out of the market. But for the average consumer they're going to primarily use their phone/tablet and we're far away from that being possible.
Even if it were possible the LLMs are such a gold mine of user data. It's really hard to see that opportunity be passed up.