5x throughput more than b4, same 10x tokens/s as compared to standard.
looks like disagg/wide ep is applicable to cerebras chips as well. kind of amazing.
https://www.cerebras.ai/blog/how-we-deploy-trillion-paramete...
They talk about Kimi - I would love to run that on cerebras, but it's not available from them directly. Is there a provider I can use this at?
They talk about Kimi - I would love to run that on cerebras, but it's not available from them directly. Is there a provider I can use this at?