alt Hacker NewsThat's what I'm saying. Either one could be Facebook. Or it could be Friendster. The rise of local models raises the even more daunting possibility that nobody becomes Facebook, but you have to imagine somebody will win the consumer market for people who just don't want to bother figuring out a local setup. That market is orders of magnitude less lucrative than the enterprise market, but a company that dominated it would still be one of the hundred or so largest in the world.
Replies
TomJansen • yesterday at 8:46 PM
I think the hardware makers are going to have the last laugh, but not sure if that would be NVIDIA
Someone can always optimize a model down to running on a typical 32 GB M6 or M5 Mac.
It doesn't need to be the best. It just needs to be good enough. I'm not smart enough, but if I was I'd be working on a locally ran interface engine. That's where you charge say 100$ a year. Said engine would allow you to use a large open source model locally to the point where it's good enough to rival Haiku.
If I had to guess someone is working on this