alt Hacker News> (even though it'll probably still get there in the end)
Burning up tokens/credits needlessly as it does so. That might be a non-issue for people using LLMs through their work but as someone doing AI on a limited budget that's an issue that drives me up a tree!
Replies
__del__ • yesterday at 11:25 PM
i highly recommend asking for terse or concise responses in whatever your chosen LLM calls its system prompt. you can give a brief explanation of your areas of expertise and say that you don't need those things explained to you. there are limits to how much this stuff works, but it's worth a shot
Two local models I've tried were dead sure that "How Much Is the Fish" was a 1956 song by Dave Brubeck. When asked why they thought so, both just kinda shrugged. At least that was sort of free but seriously — that's the basic knowledge recall scenario, how did it get this garbled? What else gets so horrendously garbled? How can we even know?