alt Hacker NewsIt's fun to offer this advice but I think actually practicing it is nearly impossible in many settings.
If you are a solo developer who has the patience to tinker endlessly, this advice is probably fine.
If you are responsible for provisioning AI services in a team setting, this advice starts to fall apart rapidly. OAI and Anthropic might as well be oil and water when it comes to what tools and descriptions are most ideal.
Swapping the inference provider like it's some interchangeable module is a total fantasy in most real world settings.
> Also, sometimes older models work fine
> sometimes
My users are hoping for slightly more definitive results. "Usually" or even "often" would be much preferred.
You don't neccesarily have to fallback across models. Both Anthropic and AWS Bedrock provide the same models with the same API at different endpoints and different infra. So if you have a proxy endpoint to point users at, that specific fallback case is pretty easy.
I'm not saying that works in every business or billing scenario, though.