Presumably when the power consumption costs more than the cost of replacement.

It’s not so much that these GPUs stop working after 3 years, but that newer GPUs can handle more requests with less power for the same purchase price. So the useful value of the GPU degrades until eventually it’s cheaper to replace than to keep running.

If the supply side constraints remains the same, I doubt they'll be releasing their GPUs as they could be considered strategic assets. Their current moat is largely hardware right.

In few years open weight models may be good enough for anything but advanced usecases. With right hardware, competition may grab the lower end of market using open models. There's also potential loss of interesting training data from real conversations.

I see more downsides than upsides.

Standard depreciation is 3-5 years.