logoalt Hacker News

apwheeletoday at 1:18 PM1 replyview on HN

Question for the crowd -- with autoscaling, when a new pod is created it will still download the model right from huggingface?

I like to push everything into the image as much as I can. So in the image modal, I would run a command to trigger downloading the model. Then in the app just point to the locally downloaded model. So bigger image, but do not need to redownload on start up.


Replies

newzinotoday at 2:29 PM

[dead]