Ah interesting, I didn't realize MoE doesn't need to all run in the same place.