alt Hacker NewsYep, that is exactly what happens. It's a disgrace that their models aren't open, after training on everything humanity has preserved.
They should at least release the weights of their old/deprecated models, but no, that would be losing money.
Yep, that is exactly what happens. It's a disgrace that their models aren't open, after training on everything humanity has preserved.
They should at least release the weights of their old/deprecated models, but no, that would be losing money.
We should treat LLM somewhat like patents or drugs. After 5 years or so, the models should become open source. Or at very least the weights. To compensate for the distilling of human knowledge.