alt Hacker NewsI was inclined to listen to your take… then you started talking about having 6 graphics cards in your computer and acting like that’s a normal thing that people do…
Replies
SR2Z • today at 4:28 PM
Yeah but they're from 2020. Normal people in a few years might have that in their laptops, just clocked way down to save on power.
That's what, the same as a Mac studio?
➕ show 1 reply
nunodonato • today at 3:21 PM
we use that same model at our company, it powers not only our devs but also many business needs. We rent 1 gpu (B300), it costs around 10x less than the api costs
➕ show 1 reply
exographicskip • today at 5:36 PM
Normal for r/localllama or r/localllm maybe
The other pitfall here is that we are tempted to compare this crazy setup to frontier models when the real comparison is running this same model in OpenRouter.
This 6 GPU setup will probably outspend OpenRouter on electricity alone.