> they can replicate or beat the price with rented GPUs

They "can" is the caveat here. Rented GPUs are going up in pricing. I recently got an email that DigitalOcean pricing of GPUs were going up.

So

1. They have to get a hold of them (availability is bad)

2. They have to maintain the pricing