logoalt Hacker News

zeryx • today at 11:57 AM • 0 replies • view on HN

Do they share latency / concurrency figures (aka the deployment shape that gets them that token/s/cluster? Would be interesting if they're using deepEP/WideEP + PP and TP