This doesn't seem all that impressive for $200k of hardware? You could serve 4bit off 8xB6000 for ~half the price. No idea what throughput you'd get tho so maybe that's the flex.

Edit: This guy already did it, and you get 60% more throughput on the 8xB6000 https://github.com/kacper-daftcode/GLM5.3-8xPRO6K