logoalt Hacker News

selfhoster11yesterday at 11:50 PM1 replyview on HN

Far less than you'd think for local LLMs.


Replies

SchemaLoadtoday at 1:14 AM

Local LLMs that you can run on consumer hardware don't really do anything though. They are amusing, maybe you could use them for basic text search, but they don't have any real knowledge like the hosted ones do.