For the ones who are still wondering how so much profits, inference is a highly profitable domain: https://inferencex.semianalysis.com/profit-estimator
Fascinating site. Thanks for linking. However note if you change to "open router" pricing in some cases even B200 which is ~2y old has negative margin (and AFAIK ppl are using longer amortization than 2y - I do not know how cost are calculated here though).
Why isn't ordered by profit % per GPU? It' surely the most important indicator
Accounting for initial acquisition cost and typical depreciation/failure rate? I assume they already consider colo price, electricity, etc