logoalt Hacker News

smcleodyesterday at 10:35 PM0 repliesview on HN

It's very far behind llama.cpp, vLLM and SGLang in features yes. In part because of that but also due to some poor default settings it generally performs a lot worse as well.