logoalt Hacker News

nblgbgtoday at 3:14 PM6 repliesview on HN

Is there any advantage to using the model from Unsloth compared with https://huggingface.co/Qwen/Qwen3.8-27B-FP8 ?


Replies

benxhtoday at 3:15 PM

Depends on what software/hardware you'll run it. GGUFs from Unsloth can run on pretty much every single potato; full weights need beefy gpus

danielhanchentoday at 4:04 PM

We also made NVFP4 ones if that helps! https://huggingface.co/unsloth/Qwen3.8-27B-NVFP4

show 1 reply
petutoday at 3:28 PM

Unsloth one is gguf for llama.cpp (and some other on-device engines).

So advantage is not having to produce your own quantisation / gguf from .safetensors you've linked.

satvikpendemtoday at 5:10 PM

Unsloth usually also fixes the models when they bork something, which always happens. For Gemma for example the tool calling wasn't working for the longest time.

show 1 reply
4chandailytoday at 3:29 PM

Run the unsloth if you are using llama.cpp (GGUF)

Run the one you linked if you are running vllm (safetensors)

ycui7today at 5:26 PM

if you have the VRAM, use offical release. quantized model lose focus after long context and can do damages or thinking loop