Storage doesn't require the same capex/upfront investment to get that margin.
How much does it cost to train a cutting edge LLM? Those costs need to be factored into the margin from inferencing.
Buying hard drives and slotting them in also has capex associated with it, but far less in total, I'd guess.
https://parasail.io, https://www.baseten.co