logoalt Hacker News

Show HN: Janus – Go binary that runs GGUF models via Vulkan on AMD/Intel/Nvidia

30 points • by Maverick617 • today at 8:36 PM • 4 comments • view on HN

Comments

peddling-brink • today at 10:38 PM

> llama.cpp via Vulkan (AMD / Intel / NVIDIA) or CPU fallback

I got excited about someone paying attention to intel. Oh well.

dlcarrier • today at 10:40 PM

From what I've seen, Vulkan adds a lot of overhead on Intel hardware.

PcChip • today at 9:19 PM

I didn't see any benchmarks against vllm, sglang, exllama, etc

➕ show 1 reply