alt Hacker NewsIt costs something like $300,000 for the hardware to run a model of that size. You'd pay that for a single model for 1-2 years? Not even the AI companies can justify that kind of spend which is why they keep extending the expected lifespan on their hardware in the accounting.
Replies
mdp2021 • today at 12:03 AM
> It costs something like $300,000 for the hardware to run a model of that size
You did not compute that as the cost for a speculative card from Taalas, right?
➕ show 1 reply
I'm expecting the Taalas MSIC version to cost a fraction of that. Then probably have some kind of cheap subscription to Anthropic for updates (yes, Taalas chips can receive a certain kind of updates: they have a small SRAM).