MoE models can use system memory along with a GPU.