alt Hacker NewsGreat reminder to be using multiple providers (i.e. Anthropic 1P, Bedrock, Vertex AI, Azure) with auto-fallback.
Bedrock has been fine throughout today; just pick two providers and you have much more stable Claude :)
Also, sometimes older models work fine, Opus 4.8/4.6/4.5 are worth trying.
Replies
wartywhoa23 • today at 9:03 AM
Never put all AI taxes in one basket!
It's fun to offer this advice but I think actually practicing it is nearly impossible in many settings.
If you are a solo developer who has the patience to tinker endlessly, this advice is probably fine.
If you are responsible for provisioning AI services in a team setting, this advice starts to fall apart rapidly. OAI and Anthropic might as well be oil and water when it comes to what tools and descriptions are most ideal.
Swapping the inference provider like it's some interchangeable module is a total fantasy in most real world settings.
> Also, sometimes older models work fine
> sometimes
My users are hoping for slightly more definitive results. "Usually" or even "often" would be much preferred.