What's the most cost-effective way to run open source models using cloud infrastructure? AWS? Digital Ocean? salad.com? Lambda.ai? Vast.ai? Use case is infrequent and small usage, but needs to be able to scale to match increasing demand.
ssh admin.hotaisle.app
Modal is great for infrequent batches.