alt Hacker NewsThe local LLM argument never really held water tbh. You can get surprisingly good performance for lightweight tasks locally, but you're just fighting economies of scale if you're going trying to beat a datacenter on cost.
Replies
simianwords • yesterday at 7:43 PM
Local LLM argument was always ideology first and never ever about economics.
I just gave you the ROI on a retail blackwell card, the math checks out, particularly on overpriced Haiku and Sonnet, what do you mean by "you're just fighting economies of scale if you're going trying to beat a datacenter on cost" ?