This was true when Moores law wasn't dead. Per watts performance has been flat since Ampere. There is a reason why undervolted 3090s are still used.
Performance goes way up if you use liquid nitrogen to cool the chips. Maybe finally someone's willing to pay for that.
GPUs do have a life expectancy. They don’t run forever, especially at high temperatures and full utilization.