logoalt Hacker News

Balinares • yesterday at 9:53 PM • 0 replies • view on HN

Wow, interesting. What KV cache quantization do you use?