logoalt Hacker News

lccerinatoday at 2:03 PM1 replyview on HN

How many devs would be able to keep working if GitHub disappeared tomorrow? You can do inference on SOME laptops, but the current shape of GenAI need massive data centers to be used at scale.

Also the existence of various big tech companies rely on these data centers being place, without them they are useless.


Replies

zozbot234today at 2:14 PM

The nice thing about local AI is that it really can run anywhere, you just need enough storage space for the weights and the context. It just gets slower if you run it on potato-level hardware.

show 1 reply