> why wouldn't capital drive the value of inference to the absolute bare minimum?

Capital can drive the cost of inference down but the value is determined by whoever wants to pay for that inference. Therefore this question is not answered: how valuable really is these llm inferences and how much of a supply of such inference does the world really need.