logoalt Hacker News

nradovtoday at 5:44 PM1 replyview on HN

The moat is shifting from technology to access to proprietary training data. It doesn't matter how good your LLM platform is if you don't have good data to feed the training run. Public Internet data and published media is already mined out. Now the frontier LLM vendors have shifted to licensing proprietary data that's locked up behind corporate firewalls, and even hiring human domain experts specifically to create new training content in target verticals. You'll see the effects of this next year, although it might not be obvious to those who mostly only use LLMs for coding tasks in popular programming languages for which there was already a lot of training data.


Replies

lelanthrantoday at 6:03 PM

> Now the frontier LLM vendors have shifted to licensing proprietary data that's locked up behind corporate firewalls, and even hiring human domain experts specifically to create new training content in target verticals.

That's a losing proposition for any token provider - it's expensive and slow, and when you're done everyone with money to rent a last-gen H100 is going to distill your "closed" model anyway.

show 1 reply