It would be interesting to hear their contingency plan for any kind of disaster (most commonly a fire) that hits their data center.
They use the datasenter for model training, not to serve online users. Presumably even if it will be offline for a week or even a month it will not be a total disaster as long as they have, for example, offsite tape backups.
Flooding due to burst frozen pipe, false sprinkler trigger, or many others.
Something very similar happened at work. Water valve monitoring wasn’t up yet. Fire didn’t respond because reasons. Huge amount of water flooded over a 3 day weekend. Total loss.
Theres only one solution to this problem and its 2 data centres in some way or form
the plan is to not set it on fire. If your office burns down you are already screwed
Yep, does anyone remember the OVH fire[1][2]?
[1] https://www.techradar.com/news/remember-the-ovhcloud-data-ce...
[2] https://blocksandfiles.com/wp-content/uploads/2023/03/ovhclo...