It feels like (to me) that Google's TPU advantage (speculation is Meta is buying a bunch) will be one of the last things to be commoditized, which gives them a larger moat. Normal chips are hard enough to come by for this stuff.
Also, they have all the infra to actually use all that tpus advantage (as well as actual researchers, contrariwise to OpenAI)
OAI is already working on shipping their own chips.
Also, they have all the infra to actually use all that tpus advantage (as well as actual researchers, contrariwise to OpenAI)