and Glimmer has 10x active params of Lightning. Meaning ~ 10 slower on same HW
Is that the case?
If the entire model fits in vram, won't the tps be comparable?
alt Hacker News
Is that the case?
If the entire model fits in vram, won't the tps be comparable?