Like this: https://en.wikipedia.org/wiki/Times_Beach%2C_Missouri

Scrape off all the soil, put it in casks, and bury it in a concrete bunker for 10000 years. Then relocate everyone and attempt to rebuild.