So you want to use OpenRouter?

could not agree more one pet peeve of mine is that using strict json output also does not work on all the endpoints of the models so I have to go through them one by one try it out and then only whitelist them.

That looks absolutely horrifying. What are the alternatives ??

Excellent post, thanks for the article. This is very relevant for anyone using openrouter and similar services seriously.

I feel there is still a lot of progress to be made before we can really trust LLM providers.

I noticed some strange behavior when I was setting it up to avoid providers that collect data, hence blocking default providers. Definitely it is worth filtering well tested providers, which is a feature OpenRouter provides.

great post, I just put $100 in credits on open router to try different models, I think maybe using the "real" provider is the way forward once I've spent my credits and decided which one I want (for now).

Wish this had more insights on 'cost' - I found OpenRouter credits to burn up fast.

Good job

Yes

[dead]