alt Hacker News> Free versions are abundant,
Awesome, can I make my own competitive LLM, just like I can make my own open source software?
> and in some time useful models will ship preinstalled on all mobile phones.
Considering hardware prices, that "some time" is doing super heavy lifting. It could be 10-15+ years before that happens and the local LLM is actually useful. Most people don't see hardware prices declining from current prices until at least 2030, likely much longer.
Replies
Edit: There.is.no.hope.reality.has.left.the.building.
Oh, well, I guess I'll just wait for the bubble to pop for the over-excited SF fans to cool down.
I'm having a TON of flashbacks about cryptocurrency discussions.
> Can I make my own competitive LLM?
Yes, yes you can.
See the number of startups that have finetuned or trained an OSS model to build their business on.
“But you have to have compute!”
Ok, and you’re writing OSS on a rock with no internet connection?
The world has all kinds of barriers, but if anyone has a chance of competing on the LLM from it’s not going to be by getting rid of fair use.
No. I also cannot make a competitive computer, yet can use one for my work to remain competitive.
Yes, it could take some time to arrive on phones. It is questionable if it will ever make sense compared to using a paid hosted provider.
But what are 10 years in the grand scheme of things?
Should we have scrapped it all, called it a crime against humanity, and never developed AI, because it will take a decade to disseminate the benefits to everyone?