logoalt Hacker News

iamflimflam1last Sunday at 1:55 PM1 replyview on HN

This only works well if you are creating sub agents with clean contexts for each task. If you constantly are switching models part way through some work then the whole session needs to be replayed each switch. You lose all the benefits of the context cache.


Replies

xyzsparetimexyzlast Sunday at 2:37 PM

Well yeah, it'd require the models to be loaded on the same system and the cache to be shared between them somehow

show 1 reply