The US is fairly unique in imposing an "expatriation" tax precisely to avoid this situation. The IRS taxes all of their assets as if sold on the day before expatriation.

Of course collecting taxes internationally is difficult, but anyone wealthy enough to meet the criteria will probably need to visit the US at some point.