logoalt Hacker News

hedgehogyesterday at 8:16 PM0 repliesview on HN

See sibling answer but essentially the effectiveness of cache is not diminished by having a separate one per model (relative to the win of doing more turns and generation with a cheaper model).