logoalt Hacker News

drdaemantoday at 7:06 PM0 repliesview on HN

Isn't that just a token noise from a broken implementation or model quantization? I've had models spewing out nonsense like that, every time it was either that there was a bug in llama.cpp or some messed up .gguf.