logoalt Hacker News

csullivannetyesterday at 9:10 PM1 replyview on HN

API calls get more expensive, not less, as you've loaded more context. This is exactly when you want to switch to cheaper models.


Replies

camdenreslinktoday at 12:01 AM

There is caching to consider. Switching models throws away the cached tokens.