alt Hacker NewsSome yes, others no. Distillation and quantization can't be used to make new base models since they require a preexisting one.
Some yes, others no. Distillation and quantization can't be used to make new base models since they require a preexisting one.
it enables models larger than was previously possible.