Jevons Paradox [1]
> when technological improvements that increase the efficiency of a resource's use lead to a rise, rather than a fall, in total consumption of that resource.
[1] - https://en.wikipedia.org/wiki/Jevons_paradox
Las Vegas replaced the expensive incandescent lighting on the strip with cheaper to run LED equivalents. But the costs didn't come down because they were able to add more lights and larger displays.
I think the same will happen with tokens. As the cost of tokens comes down, these models will just consume more tokens.
Jevon's Paradox says nothing about the size of the incremental demand though. Lighting is a great example. The US went from spending 15% of our electricity on lighting to ~4%. LEDs are maybe 5x as efficient, so that would be 3% without any change in usage. So we did see maybe a 30% increase in consumption as a result of lower prices, but that was nowhere near large enough to offset the efficiency gain in terms of overall consumption. Las Vegas may have, but that is a very small part of overall usage.
I anticipate we will see something similar with intelligence. There is probably headroom to consume 100x as much intelligence in R&D. But that isn't most of the economy. Will run of the mill service jobs increase their use of intelligence by enough to offset the effect of cheaper prices? I think that's the real question.
Definitely not going to argue against the Jevons paradox in general, it is observed in various cases.
The lightbulb thing seems different though? Or at least it is a specific subset. Lights in Las Vegas are sort of an advertisement, right? In the sense that having the brightest or most interesting (or whatever) lights draw attention to your show, casino, hotel, whatever. It’s kind of a zero sum game in that the different shops are competing for the finite attention of a more-or-less set number of tourist. I think part of the Jevons paradox is that society generally finds more useful applications of the newly cheap thing. If the thing’s only purpose is to compete better in a competition with a set prize (all of the tourists’ money), that’s constrained in some way.
Intelligence is weird though. I guess we could eventually hit the point where, I dunno, maybe there’s some information theoretic bound where we process all of our signals as cleverly as possible and aren’t bound by intelligence anymore. Obviously we’re nowhere near that. It would be a very alien environment.
> I think the same will happen with tokens. As the cost of tokens comes down, these models will just consume more tokens.
That sounds a race to the bottom for AI companies profits.
I do not think that LEDs are high profit margin items.
Tokens for sure because we still waiting for agents talking to agents as a default. Like your agent team and very long or 24/7 running agents.
But we never scaled intelligence like this. The industrieal revolution created for the people at that time quite a huge issue / it was disruptive.
What will hapen to us though?
Sounds like a variation on the induced demand principle: https://en.wikipedia.org/wiki/Induced_demand
Related:
- Parkinson's law: "Work expands to fill the available time." https://en.wikipedia.org/w/index.php?title=Parkinson%27s_Law
- Lewis–Mogridge position: "Traffic expands to meet the available road space." https://en.wikipedia.org/wiki/Lewis%E2%80%93Mogridge_positio...
And I pretty much just plain agree, this is exactly what will happen.
I don't think there's anything wrong with it (in isolation) either, though I do already find myself pointing out that we're misusing LLMs at work sometimes (most notably, a recent mini project could have been a jinja template - and it did become one thanks to me pushing back on this). Abundance is one thing, waste and misuse is another.
Turns out Grey Goo was just thermal paste
> But the costs didn't come down because they were able to add more lights and larger displays.
People are a gas; they expand the fill the space they're in. If you give someone a big house, they'll fill it with crap. If you make food cheap, they'll eat too much, even when it harms their health.
Making things cheaper usually just makes making them more prevalent. It's why computers are not faster than 20 years ago. They're merely more capable -- developers quickly and aggressively fill up (and overflow) all that added capability until you're back in the same place you used to be.