logoalt Hacker News

simonwtoday at 5:10 PM3 repliesview on HN

I ran some pelicans at the four different reasoning levels (none, low, medium, xhigh - apparently high and xhigh are aliases of each other) on a DGX Spark using Unsloth's unsloth/Qwen3.8-Flash-Next-GGUF (UD-IQ1_S):

https://tools.simonwillison.net/markdown-svg-renderer#url=ht...

Surprised I didn't get one I liked as much as the Qwen 3.8 27B one https://simonwillison.net/2026/Aug/16/qwen-38-27b/#the-defau... , maybe because of quantization.


Replies

kzrdudetoday at 5:13 PM

If I read correctly, that's based on a 1-bit quantization, and can we really expect that to produce any useful output at all?

badatnamestoday at 6:08 PM

You should find an excuse to offer 3D printed extruded pelicans from various models as awards for something. I have no idea for what, but the idea captivates and I'd love to win one somehow. They'd be collector's items in a few decades

show 1 reply
coder543today at 5:55 PM

The spark can easily run UD-Q4_K_XL on this model... using IQ1_S doesn't make much sense.