logoalt Hacker News

tankenmatelast Saturday at 9:51 AM0 repliesview on HN

I run llama.cpp using Vulkan and AMD CPUs, no need to install any drivers (or management software for that matter, nor any need to taint the kernel meaning if I have an issue it's easy to get support). For example the other day when a Mesa update had an issue I had a fix in less than 36 hours (without any support contract or fees) and `apt-mark hold` did a perfect job until there was a fix. Performance for me is within a couple of % points, and with under-volting I get better joules per token.