how does this compare to https://github.com/EricLBuehler/mistral.rs ?
Much simpler codebase because it has much less features. It doesn't aim to be a llama.cpp competitor AFAIK.
alt Hacker News
Much simpler codebase because it has much less features. It doesn't aim to be a llama.cpp competitor AFAIK.