Meta's GB{2,3}00 Cluster

It seems that Meta didn't mention one aspect of their "next-generation" AI training system: their incompetent web crawler hammers websites while completely ignoring robots.txt. Meta's 57.141.0.0/24 made up about 90% of all requests to my server this past week, and it didn't stop after I blocked it. They continue to make a request every 2 seconds despite me responding with a 403 every time. Truly an engineering marvel that Meta has bestowed upon us.

Posting this two days before earnings seems to indicate that there is going to be some bad capex news.

Actual title: ”Inside Prometheus: Meta’s Journey to a Gigawatt-Scale Supercluster”

shell glob rather than RE? what's the world coming to!