logoalt Hacker News

aabdi • today at 1:48 AM • 1 reply • view on HN

5x throughput more than b4, same 10x tokens/s as compared to standard.

looks like disagg/wide ep is applicable to cerebras chips as well. kind of amazing.

https://www.cerebras.ai/blog/how-we-deploy-trillion-paramete...


Replies

oivaksef • today at 3:38 AM

They talk about Kimi - I would love to run that on cerebras, but it's not available from them directly. Is there a provider I can use this at?