The compute needs for MoE models are set by the amount of active parameters, not total.