Why wouldn't developers just do llm arbitrage against openrouter if it is a better deal?
For the same reason people don’t do server arbitrage because Hetzner is cheaper than AWS.
The problem is different. OpenRouter is a router to LLMs. It doesn't solve GPU underutilization.
For the same reason people don’t do server arbitrage because Hetzner is cheaper than AWS.