logoalt Hacker News

datadrivenangeltoday at 5:13 PM1 replyview on HN

LLM hardware wants to be shared. It's significantly more efficient economically to have expensive hardware be better utilized.


Replies

leoctoday at 6:32 PM

I wouldn’t say so. Once local solutions pass a threshold of affordability consumers tend not to mind too much about their inefficient resource utilisation: see the many thousands of MacBooks which sit largely idle for most of the day. And efficient utilisation is actively against the interests of hardware manufacturers, at least while they’re not supply-constrained and looking to sell their limited supply to whomever can pay top dollar.