alt Hacker NewsOur codex on AWS Bedrock read / write cache ratio was less than 5%. Cache writes are very expensive and they were never being used. This results in codex on Bedrock causing ~10x what it should due to no caching and massive writes.
The workaround in issue resolved for me: web_search = "disabled"
Replies
chrisweekly • today at 4:58 AM
"causing" -> "costing", right?
yablak • today at 4:39 AM
Way to bury the lede..
If you’ve got a workaround, I’d suggest updating the issue description to have it up top there so similarly impacted users can spot it quickly and benefit.