alt Hacker NewsSmells like a cover story for military AI module validation testing.
The AI industry spends crazy money to reduce latency and increase density. The act of placing resources in space, to be used by people on earth, only increases latency, and reduces density. The performance metrics are ops/power/space/$, not G ratings, unless its being validated for flight.
Replies
Maybe. But it’s also Google, a company famous for just spending money on random crap. Data centers are politically toxic right now, and Elon Musk’s bloviating made it trendy to discuss AI in space. Maybe they think that following this trend with a relatively simple launch will raise the stock.
I think it’s somewhat impressive they got it into orbit quickly since surely a year ago this wasn’t an earnest idea, and I think it’ll be interesting to see the affects of space on high end chips and connectivity fabric.
But also I agree that this just doesn’t make sense from a performance standpoint.
Terrestrial data centers are having a hard time connecting to power. What’s the good of a $40/Watt compute asset you can’t turn on? Spending $10 or even $20/Watt extra to get power by sending inference load to orbit starts to sound like a bargain, and that’s doable with today’s launch vehicles. With high reuse, that number drops to below $1/Watt for 24/7 power, which makes it cheaper than any terrestrial energy source. And the vast majority of compute load is inference. Part of the training process benefits from a large, coherent (ie low latency) data center, but that’s a minority of the load nowadays.
Also: low Earth orbit is already pretty low latency. A lot of people’s intuitions about space latency are from when satellite internet was based out of distant geosynchronous satellites, but even that is probably just fine for most inference workloads.