https://www.mooreslawisdead.com/post/sam-altman-s-dirty-dram...
On October 1st OpenAI signed two simultaneous deals with Samsung and SK Hynix for 40% of the worlds DRAM supply... the shock wasn’t that OpenAI made a big deal, no, it was that they made two massive deals this big, at the same time, with Samsung and SK Hynix simultaneously! In fact, according to our sources - both companies had no idea how big each other's deal was, nor how close to simultaneous they were. And this secrecy mattered. It mattered a lot.
Had Samsung known SK Hynix was about to commit a similar chunk of supply — or vice-versa — the pricing and terms would have likely been different. It’s entirely conceivable they wouldn’t have both agreed to supply such a substantial part of global supply if they had known more...but at the end of the day - OpenAI did succeed in keeping the circles tight, locking down the NDAs, and leveraging the fact that these companies assumed the other wasn’t giving up this much wafer volume simultaneously…in order to make a surgical strike on the global RAM supply chain…and it's worked so far...
OpenAI isn’t even bothering to buy finished memory modules! No, their deals are unprecedentedly only for raw wafers — uncut, unfinished, and not even allocated to a specific DRAM standard yet. It’s not even clear if they have decided yet on how or when they will finish them into RAM sticks or HBM! Right now it seems like these wafers will just be stockpiled in warehouses – like a kid who hides the toybox because they’re afraid nobody wants to play with them, and thus selfishly feels nobody but them should get the toys!> Had Samsung known SK Hynix was about to commit a similar chunk of supply — or vice-versa — the pricing and terms would have likely been different
Wouldn't this be ... collusion?
Implicitly arguing that the memory oligopoly should have been coordinating is ... quite something.
OpenAI may well be doing something anticompetitive by cornering supply to foreclose competitors, but saying "they tricked the suppliers into not colluding!" is certainly a take you can have I guess.
Only 50-60% of the recent price appreciation is after October 1st, so this is not likely the biggest direct cause, more likely it's everyone buying the finished stock on the market in a frenzy because they anticipate things like this will impact availability in the future, and it becomes a self-fulfilling prophecy.
Sounds like OpenAI might be trying their hand at TPUs, like what Google has. They are one of Google's biggest advantages in AI right now. It would also give them insurance against Nvidia being everybody's hardware supplier.
Novice question: If they built something other than classic dram modules with the wafers maybe they could achieve faster bus speeds? How does Apple do it?
The cynic in me thinks this would be a convenient way for these memory producers to manufacture demand, while also making OpenAI look good on paper. It’s not like they haven’t been caught price fixing in the past. Win win for these companies and a loss for everyone else.