Depends on your hardware, but this build of [ninfer][1] runs inkling-2-mini for me at 77 tok/s versus llama.cpp at 30 tok/s. So far it has been pretty good. Solved some things that qwen3.8-27b could not.
[1]: https://github.com/iamwavecut/ninfer-all
Ah, I have an AMD card, so doesn't look like that's viable for me
Ah, I have an AMD card, so doesn't look like that's viable for me