alt Hacker NewsThat's like saying "forklifts are a terrible idea, because a forklift is excessive for lifting 99% of the items that I can lift". See the problem?
"AI use cases" is a moving target! If you try to define "use cases" by "what AIs today can be used to do", you miss things AIs would do in the future. The more capable and price-performant AIs get, the more there are places where AI has a role.
This is a big part of what the frontier buys you.
The other big part is that going from a local AI to a frontier model often makes the difference between "this use case works 60% of the time, good tech demo" and "this use case works 99% of the time, good business decision". The difference between "clunky and needs human in the loop" and "just works" is worth paying the API price.
Replies
The forklift analogy proves the opposite point.
There is no business model for competing companies to build forklifts that can lift an infinite amount.
That is not to say attempting to do so would not find new use cases for such powerful forklifts. The problem is the cost of building ever increasingly powerful forklifts while the TAM for that power shrinks.
You don't even have to bring in the enormous difference between forklift rusting theta vs gpu theta.
Except that’s simply not how it works. Companies just have one forklift. Yes it’s too much for most use cases but you don’t have a garage full of different sized forklifts. There’s a big cost to keeping all these extra forklifts on standby.
Models, however, are completely interchangeable on demand. That’s why companies are building these realtime internal marketplaces to route tokens to different models. Anthropic may win the occasional “bleeding edge” use case but the money is in the day to day use cases that get routed to the cheap-but-works options. There’s zero cost to having all the forklift sizes at your disposal and only using the size needed when it’s truly needed.
Anthropic is trying to sell the biggest baddest forklift in a world where companies can swap out cheaper ones easily and on demand. Hence why Anthropic doesn’t appear to have a viable business model in its current form.
The forklift market seems to be in the $90-$95 billion / year while the global passenger car market is $2.9 trillion.
This is the problem.
While the frontier labs will always have a market for AI that can do things the other models can't, if the sliver of work that can be done only by the frontier models is narrow enough, then what they spend to train those frontier models may not let them capture all that much extra revenue.
I absolutely think there will be a market for frontier models pushing further and further.
But it's not yet a given whether or not being ahead on capabilities is going to buy them all that much more higher earnings relative to lower tier providers.
If it stays the case that going from local AI to a frontier model makes the difference between 60% and 99%, then they probably will, but there's nothing to suggest local or open model, or second-tier closed models won't keep moving ahead as well, and eat away at the use cases where only a frontier model will do.