logoalt Hacker News

ballon_monkeyyesterday at 7:20 PM1 replyview on HN

Bedrock is really bad. It seems like they don't host the models very well because they produce tons of bugs/errors calling the model. For example you can end up with Anthropic models not returning a stop token and you end up waiting for a timeout thinking its doing something when it isn't.


Replies

Betelbuddyyesterday at 7:38 PM

Well Anthropic hosts their models at AWS, ( and at many others...) so maybe the AWS team can ask them how they do it ;-) ?