You got it backwards; it's ~200 on single stream so the 2,600 is achieved with ~13 streams.
Yeah that makes sense. I'm more familiar with seeing tok/s/user + TTFT rather than the total node throughput.
alt Hacker News
Yeah that makes sense. I'm more familiar with seeing tok/s/user + TTFT rather than the total node throughput.