alt Hacker NewsThey aren't "fast-depreciating infrastructure" -- research shared by a16z team, rental rates are up across the board, even for GPUs that are 5+ years old. The demand is real right now. The proverbial tide could go out but we aren't seeing it yet.
Source: https://x.com/a16z/status/2113986385908842870
"Zooming out, GPUs are still renting ahead of a standard 6-year depreciation schedule
Rental price vs. schedule: - H200: +143% - B200: +111% - RTX PRO 6000: +73% - H100: +54% - A100: +9%
Most of the gap opened up after April, when token demand took off"
Replies
Yeah the fab shortage is really keeping lifetimes long, far longer than in the past.
I've brought my old GTX 1070 out of retirement for for some molecular dynamics these days because its "free" except for eh electricity and have Ben pleasantly surprised at what it can get done chugging along in the background. I'm considering buying some more, as it's kind of a steal in pricing.
That’s because of current supply shortage, not inherent value. Is there any reason to believe that when fabs can sufficiently scale up production these GPUs will continue to be valued like gold and not something you hold on to for a couple years and then toss in the bin for a newer faster model – aka how computer hardware economics have worked for the last 50 years?