logoalt Hacker News

syntaxingtoday at 5:26 PM0 repliesview on HN

Would I be surprised there’s bench maxing happening? Yes. But some users also use Q4 quantized and complain how dumb local models are.