alt Hacker News> If tpu's actually breakout as a viable alternative over the next few years
Why haven't they broken out yet, I wonder, if they're more efficient for inference and LLM costs are now weighted towards inference over training?
Replies
lanthissa • yesterday at 9:36 PM
there are literally not enough tpu's on earth for them to break out, every tpu thats been made is in use, the spike in demand is recent and google has heavy competition for foundry space.
chris_st • yesterday at 8:52 PM
Possibly because they just haven't been able to manufacture enough of them yet to be a viable business to others? They're fighting everyone else for foundry space and time.
You essentially have to run in google to use them and that probably limits their ability to breakout. Anthropic might be doing this deal as a way to shore up their supply chain and cost of both inference and training by leveraging Google's hardware and chip manufacturing expertise.