alt Hacker NewsI wonder if it's related that that OpenAI has found a way to cut inference costs by half, according to The Information.
https://www.theinformation.com/newsletters/ai-agenda/openai-...
Replies
drivebyhooting • today at 1:50 AM
What’s the technique? And did they buy it from thinking machines?
➕ show 1 reply
minimaxir • today at 2:51 AM
Semi-related, has anyone noticed their GPT 5.5 usage in Codex being cut in half as of a couple days ago? I got a lot more mileage out of my session usage yesterday for the same workload.
https://archive.ph/NEwVz
"However, these inference optimizations, which rival Anthropic refers to as “compute multipliers,” are a big focus for all the labs. Anthropic CEO Dario Amodei has been publicly talking about the concept since at least mid-2023, when he said on a podcast that the company limits “the number of people who are aware of a given compute multiplier” because it could give other AI labs a leg up if they were to be able to replicate them. (Compute multipliers can also refer to efficiency optimizations in the model-training phase.)"
Yes, on a world with finite resources where your industry is singlehandedly siphoning ALL THE RESOURCES - hoard general efficiency optimizations and treat them as trade secrets - winning is all that matters, normal people and other species and the planet be damned.
Everything I hear about Dario these days makes me like him less and less. He sure did seem to speed run the 'tech leader with scruples' to 'tech villain' path! I guess all the cycles are compressing as we approach the singularity..