Tokens per megawatt is about to go through the roof with things like disaggregated inference on the horizon.
This is going to quickly become similar to worrying about how many trainloads of coal it takes to run everyone's WiFi router.
https://en.wikipedia.org/wiki/Jevons_paradox
It costs less -> we use much more -> total resource usage increases
https://en.wikipedia.org/wiki/Jevons_paradox
It costs less -> we use much more -> total resource usage increases