alt Hacker NewsWhat use are weights without the hardware to run them? That's the gate. Local AI right now is a toy in comparison.
Nukes are actually a great example of something also gated by resources. Just having the knowledge/plans isn't good enough.
Replies
fooker • today at 2:03 AM
> hardware to run them
Costs a few hundred thousand per server, it's a huge expense if you want it at your home but a rounding error for most organizations.
➕ show 1 reply
reactordev • today at 2:02 AM
I run local models on Mac studios and they are more than capable. Don’t spread fud.
➕ show 1 reply
Scaling has hit a wall and will not get us to AGI. Open-source models are only a couple of months behind closed models, and the same level of capability will require smaller and smaller models in the future. This is where open research can help: make the models smaller ASAP. I think it's likely that we'll be able to get something human-level to run on a single 16GB GPU before the end of the decade.