Imagine if OpenAI weren't locked into Azure's stack.
A lot of people seem to think multi-cloud is an unrealistic dream. But using best in class primitives that are available in each cloud is not an unreasonable thing to do.
OpenAI is locked into _someone's_ compute resources... the one that is the cheapest. AFAIK OpenAI doesn't have much (any?) of their own hardware. With the mega-clouds buying up all the GPUs and building datacentres, you have to 'partner' with someone. Most likely the one that gives you the biggest discounts. The amount of compute that OpenAI needs dwarfs almost any other consideration.
OpenAI is absolutely not locked into the Azure stack. https://en.m.wikipedia.org/wiki/Stargate_LLC
All organizations that are reasonably large and for which cloud costs is a large portion of expenses have an abstraction layer to switch between providers. Otherwise it’s impossible to negotiate better deals, you can’t play multiple cloud providers against each other for a better rate.
Yes, and OpenAI has enough financial resources to do a bespoke abstraction layer with multiple provider-specific performant implementations.
Regardless of whether they bring in the Kubernetes complexity.
(Internal codename: Goober Yetis.)