alt Hacker NewsNot a finance guy, so fully prepared to be wrong here. But my interpretation is that an increase in price corresponds to a shorter lifespan. i.e. less time to make money so we need to charge more to get the same return over less time
It could also be a supply/demand issue, generally price increases are caused by either 1. demand increasing, or 2. supply decreasing.
In this case we can interpret a shorter lifespan as decreased supply, but it can also be because the demand for GPU compute has gone up. I think in this case we're seeing a bit of both, but it's hard to tell without more data.
We could also consider the supply / demand elasticity changing, f.x since demand has become more price inelastic it could result in a higher price.
Replies
Oh my reasoning was coming at this from a different angle: H200s were released in November of 2023, so they're over 2 years old at this point while still being valuable
The thing historically about GPUs has not been the actual lifespan of the hardware (at least half of the hardware will probably work fine for 10 or more years) the problem is that work/watt is dropping for newer hardware, so there's a point where even if you had an equivalent quantity of 10-year-old GPUs, powering them for some period costs $40k and you can buy a single brand-new GPU that costs $40k but only costs $20K to power for the same period which is less than a few years.
I don't think we're seeing any decrease in supply though, ignoring 2020 I'm pretty sure the number of GPUs manufactured has been steadily increasing. It might be the case that projected manufacturing was higher than what actually happened, which is not the same thing as a decrease in supply, but companies like Amazon will talk about it like it is, and from the standpoint of their pricing it essentially is.