logoalt Hacker News

slipheentoday at 8:19 PM0 repliesview on HN

Does it say anywhere which model it’s using?

I see references to vLLM in the GitHub but not which actual model (Llama, Mistral, etc.) or if they have a custom fine tune, or you give your own huggingface link?