Some of the price performance improvement that is quoted is due to using $ from different cloud providers - eg a GH200 in Lambda Labs costs $1.5/hr, but the closest equivalent in AWS (p5.4xlarge) costs $6.88/hr. Which means, ~4.5x of the price performance benefits is not real ...