alt Hacker NewsThen why have they been lagging behind OpenAI and Anthropic for most of the last few years, and only briefly been at the frontier?
Replies
> Then why have they been lagging behind OpenAI and Anthropic
Because they're not desperate. Slow and steady wins the race, at this rate all Google has to do is wait for OpenAI and Anthropic to exhaust themselves on aggressive training, then they can casually amble along right past them.
Alphabet isn't just an AI lab, they're an ad company, a search index, a media distribution company, an email provider, office tool provider, a OS developer, a browser developer, a smartphone brand (Pixel), cloud provider, DNS, amongst a plethora of other services and goods.
OpenAI and Anthropic are AI business, if the AI market burst tomorrow, they'd be the first to flounder.
Google just has to keep pace in the AI space, they don't have to lead. Especially since whom is leading changes like two or three times per month non-stop for four or so years now, including small (by US standards) Chinese AI labs with a fraction of the money who keep pushing the tech forward every month while being open for now.
> Then why have they been lagging behind OpenAI and Anthropic for most of the last few years, and only briefly been at the frontier?
Because it's not an existential battle for Google. If OAI or Anthropic disappear from the absolute frontier for ~8 months the news cycle and churn will diminish them to the second rate. Google is processing near 4 quadrillion tokens every month, that's - I'm sure - significantly more than OAI or Anthropic, because Google is interested more so in their flash models and getting these competitive, which they are.
Given the spend requirements to stay on the leading edge and the speed (and with low cost) that others catch up, the economics support a fast follower model unless you get some benefit from being a pioneer. So far nobody has received a permanent benefit from being ahead.
Chinese models are barely behind the leaders. Google can catch up anytime they hit the gas. I think they’re intentionally spending less, and when this crazy race burns out they can play their cards.
> Then why have they been lagging behind OpenAI and Anthropic for most of the last few years,
The reverse could also said to be true. Google has models that run with search, producing usable results in well under a second. I suspect the world is consuming far, far more of those Google tokens then the tokens produced by OpenAI or Anthropic.
So why are OpenAI and Anthropic so far behind? They are serving a different market: the one that wants high intelligence / high cost tokens. Google is targeting the low cost end of the market - ie the commodity. That's where they've always played with search, email, docs and the like. That's were they are playing with AI too, and they are killing it.
Alphabet issued a very oversubscribed 100-year bond with 6.1% yield earlier this year to raise capital for datacenter expension.
Meanwhile, Anthropic/OpenAI will struggle to survive the next 24 months on their current trajectory.
From a business perspective a frontier model does not make much sense anymore if you are not a startup. Neither for Amazon, nor for Google. Their clouds need models that are fast and perform well in their agent frameworks nothing were a frontier model excels at.
Most Google products even use flash lite underneath, so their frontier model is mostly used for distillation.
Lagging by what metric exactly? Is Toyota lagging behind McLaren? (company vs company)
It only feels like that. It's been less than a year since Gemini was on top and here they are again.
Are you ready to call this race 5 years in? I'm waiting another 15 years and at least one or two new LLM architectures.
Could it just be that Demis was checked out of the race and they lacked leadership?
I think Google, mainly Demis, just made a bad bet that multimodal world models would be the key to unlocking massive progress. Anthropic made the bet that it would be coding, and they were right. OpenAI was originally betting on like hardware and trying to compete in the browser space (?) but was able to quickly pivot to coding due to their size. Google, on the other hand, is like an aircraft carrier, it takes a lot of time to course-correct.
> Then why have they been lagging behind OpenAI and Anthropic for most of the last few years, and only briefly been at the frontier?
One possible explanation: because Google is a little bit more frugal and focuses on how to make providing AI models financially feasible - combined with some willingness to burn money so that they don't strongly fall behind on their AI models.
On the other hand, OpenAI and Anthropic at least formerly concentrated on building and providing the best models that they could with concerns about financial feasibility taking a backseat.
Just to be clear: I do have the impression that by now (likely because of pressure from investors) OpenAI and Anthropic take these financial concerns more seriously, but nevertheless Google's vs OpenAI's/Anthropic's "DNAs" concerning on what to focus on differ.