alt Hacker News> Mac or PC with 16–31 GB | IBM Granite 4.2 8B | 14 of 22 right | 6 GB
So on a regular consumer machine this is going to be wrong nearly half the time. Great! Let’s hope it’s only on the simple stuff and not the “how do I perform an emergency appendectomy”.
Honestly, just buy some books.
Replies
arjie • yesterday at 9:15 PM
The advantage of a turn-by-turn flow (honestly the chat interface was genius) is that with a little human intervention you can get much better results out of even silly models. The model of choice is strange, though. Not a particularly good one.
➕ show 2 replies
dofm • yesterday at 9:05 PM
Granite is not great at any size. Wonder why they picked that.
➕ show 1 reply
Or just.. download the books, and slap a search engine on top of them. It'll be like 10x smaller than the model. "Survival LLM" is absolutely a non-relevant use case.