logoalt Hacker News

cwoolfelast Tuesday at 4:43 PM2 repliesview on HN

What's the most cost-effective way to run open source models using cloud infrastructure? AWS? Digital Ocean? salad.com? Lambda.ai? Vast.ai? Use case is infrequent and small usage, but needs to be able to scale to match increasing demand.


Replies

ipnonlast Tuesday at 4:45 PM

Modal is great for infrequent batches.

latchkeylast Tuesday at 5:37 PM

ssh admin.hotaisle.app