alt Hacker NewsOnly if you're incapable of throttling to assure quality of service. Are you saying they have so much demand that even their load balancers were overloaded?
Replies
slopinthebag • today at 7:50 AM
There is no point having this discussion. Some people have had their brains genuinely broken by Anthropic and will defend them to the last breath, despite having no clue what they are talking about.
➕ show 1 reply
Throttling helps to prevent a 30% failure rate (with a quick recovery time) turning into a 100% failure rate (with practically infinite recovery time), but some users are still going to see failures, and the news is still going to be "Anthropic is down again" because some users are seeing an outage.
I'm not really sure how they can avoid getting in the news with "Anthropic is down", TBH. Although, at least by throttling they might get "Anthropic is down for some requests" and not "Anthropic is down for all requests".