> Across 10k-100k+ servers

If you "need" that many servers (and aren't Google), you've built your systems massively wrong.