Reducing token usage is this year's "one weird trick". It doesn't make sense on the face of it.
Even if one discovered something that millions (billions?) of dollars of AI compute and the best statisticians in the world was not able to find via exhaustive research, domain search and training... what do you think are the chances this won't be folded into the next update of every model, making the rigmarole moot?
Extraordinary claims require extraordinary evidence and technology-shattering innovations in AI are not know to come from a markdown.
incentives aren’t aligned