Asbestos in safe forms does not become dangerous from fire or earthquake or flood damage.

It does becomes dangerous from badly done demolition work. And they are harmful to the people mining and manufacturing them.

But for a long while, almost every material was extremely harmful for the people mining and manufacturing them. It really took a while to determine that asbestos is actually worse than fiberglass or gypsum.