"Can't" is not really correct.

Nowadays, specially with MoE models you can run parts of the model on GPU and still get some speed up.