OAI has announced an upcoming 750tok/s 5.6 served through their cerebras acquisition
That is going to be absolutely wild for whoever can access/afford it.
Yeah, Cerebras is the one with competitive speeds nowadays but they cost an absolute fortune. Also they don't host good models publicly. Good to see OpenAI leaning into them, can't wait until these speeds are available by subscription
> cerebras acquisition
Partnership you mean?, Cerebras went public and are trading at around 45B in market cap.
While OAI could in theory cough up that kind of money, it would massively hamper their existing committed capital outlays.