alt Hacker NewsI don't think LLM inference is ever going to stop being a competitive market, though. Unless regulation or other factors make the existing players form a cartel.
I don't think LLM inference is ever going to stop being a competitive market, though. Unless regulation or other factors make the existing players form a cartel.
I think it's pretty safe to say that, unless the government steps in to prevent it, they will form a cartel or some sort of oligopoly. The incentives for them to do so are very high.