I'm using Apple Studio Displays and have been on the lookout for a solution like this for quite a while. My grail is a Thunderbolt KVM; there are a couple on the market, but they cost a fortune and have terrible reviews. I guess the use case is so narrow that nobody is investing in it.

An alternative could be a good 5K/6K monitor with a KVM, but this is a unicorn as well...