alt Hacker NewsThere will be frontier models that are non-commoditized, but they'll be kept guarded and hidden away, and you'll only get the final result, so that they can't be distilled and their harness can't be reverse engineered. They'll be billed like employees, rather than like a tool.
Replies
The economically useful frontier models will be fine tuned on data to make them useful for a specific project or task.
I doubt that. What stops the Chinese labs from figuring it out? It’s not like these models are fundamentally different from each other
Isn't that what they are doing already? The model is already guarded and hidden and i only get to send it what i want. Talk with it to clarify my requirements. And i can switch to a different provider for cheaper/better results.
They tried to do that with operating systems and the browser.
I think this will be isolated to highly specialized fields where training data will need to be selectively curated.
Everything can be distilled, it will just become more painful
The non-commodity network services of the early 1990’s and the non-commodity 3d graphics hardware of the mid-1990s made the same argument.