logoalt Hacker News

mcastyesterday at 3:10 PM1 replyview on HN

It sounds like Anthropic is dangerously low on compute availability if they’re prioritizing these refusals as their OKRs.


Replies

petcatyesterday at 3:26 PM

I think it's obvious that they are critically lacking in compute capacity especially since OpenAI has committed billions to locking up all the future compute production.

And I don't necessarily think it's wrong for Anthropic to introduce QoS or throttling on users of their models. It's pretty much a necessity when offering public access to a scarce resource and it's been a common practice for decades.

What is the alternative? We just accept that it doesn't work half the time because the system is overloaded with molt bots?

show 4 replies