Sounds like OpenAI might be trying their hand at TPUs, like what Google has. They are one of Google's biggest advantages in AI right now. It would also give them insurance against Nvidia being everybody's hardware supplier.
This actually points the opposite direction, to doubling down on commercial GPUs.
NVIDIA recently told their board partners that they will need to source their own RAM and will not be bundling it with chips anymore.
If there is a supply crunch on DRAM, commercial GPU production lines will start having idle downtime. That is literally the worst possible thing that can happen to a company that has invested heavily in tooling and they will negotiate at or below cost production runs to fill the gaps if a customer can bring their own DRAM to the table.
This actually points the opposite direction, to doubling down on commercial GPUs.
NVIDIA recently told their board partners that they will need to source their own RAM and will not be bundling it with chips anymore.
If there is a supply crunch on DRAM, commercial GPU production lines will start having idle downtime. That is literally the worst possible thing that can happen to a company that has invested heavily in tooling and they will negotiate at or below cost production runs to fill the gaps if a customer can bring their own DRAM to the table.