alt Hacker News> there are likely big efficiency wins to be gained by specializing on AI
I've seen this suggested before as well, but I don't think I've heard a lot of actual concrete things. What big efficiency wins are to be had specializing on "AI" datacenters as opposed to what the past mega hyperscalers have done? What techniques seem to be out there that cloud providers and others have slept on? What makes them so different, in terms of operating a datacenter?
I'm genuinely asking.
I know nothing about the inner workings of a large scale AI datacenter but I'd imagine the power and cooling requirements are more specialised than your average datacenter that mostly has to handle transmitting large amounts of data over the internet (not that that isn't computationally expensive, I just imagine LLMs (especially at the current scale of their deployment) are much more demanding)