alt Hacker News16 tokens / s is not nothing.
Replies
whatsThisBtn4 • yesterday at 11:25 PM
Confusing numbers everywhere.
16tk/s... Then 3 tks per minute. Then someone else posted 0.3tk/s.
Azantys • yesterday at 10:32 PM
? Readme says 60-70s per token
16 tokens / s is not nothing.
Confusing numbers everywhere.
16tk/s... Then 3 tks per minute. Then someone else posted 0.3tk/s.
? Readme says 60-70s per token
It's the other way around due to poor framing, it would be much easier to compare if you [the repo] said 0.02 tps.