logoalt Hacker News

technoabsurdistyesterday at 11:53 PM2 repliesview on HN

yes it is 213 tok/s single stream (so per user)


Replies

unrvl22today at 6:22 AM

that 213 wasn't achieved when saturated though. was probably more like 30 tps per stream when doing 2.6k tps.

3836293648today at 12:14 AM

So per subagent*.

show 1 reply