logoalt Hacker News

cm2187yesterday at 3:21 PM1 replyview on HN

I work for a large company and for any LLM I use professionally, whether programmatically or via a UI, I get to pick from a dropdown from Gemini, Claude, OpenAI and the open weight ones. We ain't locked in.


Replies

porridgeraisinyesterday at 3:27 PM

Yeah, and that is completely fine business-wise for all the businesses in that dropdown. Averaged over the whole TAM, they will all make a lot of money. The reason is that the total market becomes _bigger_ with every new model (upto a reasonable point of course, but for 5 models it is obviously true), they don't end up competing for the same slices of the pie.

The core business for each of the 5 will not be companies like yours, but rather few hundred to few thousand companies each who exclusively use their model not for technical reasons, but because they were wined and dined or due to bundling with another service. The other hundreds of thousands of customers are all bonus. This is true for most categories of SaaS not just LLM inference.

If the vendor of a core piece of software that you are already locked into tells you they are raising prices and adding AI inference features, you are going to cancel whatever AI plan you have and use theirs. Or pay the amount anyways (which is even better business-wise for them).

Eventually, semi-random differences that arise in their distribution may end up informing model capabilities as well, and _that_ is when true model-level differentiation may happen. But this is not necessary and if it comes true would just be a bonus.