logoalt Hacker News

xyzsparetimexyzlast Sunday at 2:37 PM1 replyview on HN

Well yeah, it'd require the models to be loaded on the same system and the cache to be shared between them somehow


Replies

inigyoulast Sunday at 2:49 PM

Cache sharing is not possible. The numbers in the cache are completely specific to the model.

show 1 reply