logoalt Hacker News

alfiedotwtftoday at 7:39 AM0 repliesview on HN

Are you running out of context? I’ve found that tooling and giberish most of the time happens when I’m butting up against the high watermark of my context window. One other thing it could be, I’ve read that lower quanta like Q1 and Q2 for smaller models can leak Chinese