logoalt Hacker News

phantasmishlast Thursday at 7:58 PM1 replyview on HN

It'd be kinda nice if they exposed whatever queuing is going on behind the scenes, so you could at least communicate that to your users.


Replies

aamoscodeslast Saturday at 4:40 PM

IIRC this is almost exactly the use case for OpenRouter, down to provider fallback https://openrouter.ai/docs/guides/best-practices/uptime-opti...