logoalt Hacker News

phkahlertoday at 2:10 PM7 repliesview on HN

There is an obvious question I don't see anyone asking. Why do these data centers have to be built in every state? I guarantee it's not to run LLMs.


Replies

cobolcomesbacktoday at 2:45 PM

It’s to run LLMs.

In the before-AI world, it mattered a lot where data centers were geographically located. They needed to be in the same general location as population centers for latency reasons, and they needed to be in an area that was near major fiber hubs (with multiple connections and providers) for connectivity and failover. They also needed cheap power. This means there’s only a few ideal locations in the US: places like Virginia, Oregon, Ohio, Dallas, Kansas City, Denver, SF are all big fiber hubs. Oregon for example also has cheap power and water.

Then you have the compounding effect where as you expand your data centers, you want them near your already existing data centers for inter-DC latency reasons. AWS can’t expand us-east-1 capacity by building a data center in Oklahoma because it breaks things like inter-DC replication.

Enter LLMs: massive need for expanded compute capacity, but latency and failover connectivity doesn’t really matter (the extra latency from sending a prompt to compute far away is dwarfed by the inference time, and latency for training matters even less). This opens up the new possibility for data centers to be placed in geographic places they couldn’t be before, and now the big priority’s just open land, cheap power, and water.

show 1 reply
threetonesuntoday at 2:26 PM

I guess it's an answer to the obviously absurd idea that 98% of data centers be in Northern Virginia.

My less snarky answer is -- we've always had data centers all over the place? When I started in web dev we deployed to boxes running in a facility down the street. That sort of construction probably dropped considerably when everyone went to "the cloud".

drunnertoday at 2:21 PM

The reason likely here is water. It was the same with foxcon. They want access to Lake Michigan.

show 1 reply
janice1999today at 2:14 PM

“We’re going to have supervision,” Oracle founder Larry Ellison said. “Every police officer is going to be supervised at all times, and if there’s a problem, AI will report that problem and report it to the appropriate person. Citizens will be on their best behavior because we are constantly recording and reporting everything that’s going on.”

Aurornistoday at 2:40 PM

Distributing our infrastructure is a good thing.

Putting them all in one or two places isn’t good for reliability, disaster resilience, and other things that benefit from having them distributed.

Data centers do more than just run LLMs. It’s a good thing when your data is backed up to geographically diverse data centers and your other requests can be routed to a nearby data center.

Have you ever tried to play fast paced multiplayer games on a server in a different country? It’s not fun. The speed of light limits round trip times.

> I guarantee it's not to run LLMs.

Are you trying to imply something conspiratorial?

sailfasttoday at 2:19 PM

They don’t, but Wisconsin is a pretty good spot for them.

542458today at 2:12 PM

Same reason the F35 manufacture is awkwardly distributed throughout the US - the shore up political support (voting to kill jobs in your state is usually unpopular) and dip into as many subsidies as possible.

show 2 replies