logoalt Hacker News

iainmerricktoday at 2:09 PM0 repliesview on HN

I can't see any information here about prompt caching (AKA prefix caching). That's absolutely required for any serious API usage with pay-per-token pricing. Anyone from Civo or relaxAI here able to clarify that? Thanks!