logoalt Hacker News

kittikittiyesterday at 6:01 PM2 repliesview on HN

I'm not sure why someone hasn't developed a company offering services that distributes AI across all idle or under-utilized VM's and PC's for enterprises in order to serve open sourced models. Outside of the electricity bill, there's no additional expenditure and you get the AI.

We've all seen the office spaces where there's 200 empty computers on a floor. Combined, it's something like 500 cores at ~3 Ghz each and around 3 TB of RAM. The networking is already there and software like exo already exists.


Replies

gizajobyesterday at 7:01 PM

Vibe code that app and business. It’s a great idea like a kind of SETI@Home for business but I’m not sure the compute and latency will really be good enough unless you’re talking about a business with literally thousands of machines sitting half idle and always on, or always mostly on. i imagine it would take maybe 50-100 MacBook Pros running such a service to get to Claude level performance for one or two people.

show 1 reply
sam345yesterday at 8:07 PM

I have not seen this. The one time I did it was after a major layoff. People use laptops and take them home. I'm not saying it's not viable but the scene you depict I think is outdated.