logoalt Hacker News

__stoday at 4:15 PM1 replyview on HN

Been away from home for nearly a month, so was mostly going off Qwen 3.5 122b-a10b (Q4?) / Qwen 3.6 35b-a3b (Q8) / Gemma4 31b (Q8)

Thanks for suggestion tho, tool by antirez is always going to pique interest, I'll check it out when I'm finally home again

Tho says Metal / CUDA, so doesn't seem friendly to Linux AMD system


Replies

manmaltoday at 5:56 PM

His quant that fits into 128GB looks interesting for Spark DGX as well IMO.