logoalt Hacker News

FuriouslyAdrifttoday at 6:36 PM4 repliesview on HN

We're running Kimi 2.8 on a $107k server and getting around 50k tokens per second or better on most things.

We've already saved money compared to last years token cost on Claude/Gemini


Replies

ajjutoday at 8:24 PM

What is your config?

freediddytoday at 8:21 PM

how many requests per second can the server take?

mdp2021today at 7:57 PM

> We're running Kimi 2.8 on a $107k server

Equipped with what? Is it CPU based inference, a mix...?

show 1 reply
logicalleetoday at 8:18 PM

Are you developing software? Is most of it used on a coding agent? (Like Claude Code or ChatGPT Codex?) If so, what coding agent do you use? If you're not developing software what do you use it for (roughly)?