alt Hacker NewsThere is no "future proof" for >1T param models, there is no present or future where you can run a model that size on consumer hardware.
Replies
bewareofscams • today at 3:23 PM
6 Mac Studios for 100k USD. Consider it a rule of thumb now - 100k to run 1T params, scales linearly.
I don't know that "consumer hardware" is a useful distinction anymore, it's just "what's your budget and what's your speed requirement".