logoalt Hacker News

simonwyesterday at 4:21 AM3 repliesview on HN

OpenRouter rankings frustrate me, because they show the total number of tokens but they provide no indication of how many unique users a model has.

Which means if a surprise model tops the leaderboard one week we can never be sure if it was because a single whale user pushing billions of tokens a day switched to it, or if it represents a genuine community trend towards that model.


Replies

numlockedyesterday at 10:01 PM

(openrouter co-founder here)

Yeah we should do something to indicate cardinality. I can share that there can often (I'm talking generally; not related to this model in particular) be e.g. a very large app that can be pushing a lot of volume. But in almost all cases that app has a large number of end users. Hypothetically, for instance, would Cursor be consider one user, or millions?

Will think about it! Thanks for the feedback.

show 3 replies
svantanayesterday at 9:22 AM

Also, while we're pitching new features to openrouter, I'd like to see a "$ spent" chart, which would remove all these huge freebie spikes. It looks like it would be pretty much dominated by claude.

senordevnycyesterday at 7:44 AM

Agreed. My little solo dev SaaS app’s production pipelines push almost two billion tokens a day.

show 1 reply