I never used modal or vast.ai and from their pages it was not obvious how they solve the yolo billing issue? Are they pre-paid or do they support caps?
Engineer from Modal here: we support caps. They kick in within ~2s if your usage exceeds the configured limit.
I know vast.ai uses a prepaid credits system.
Engineer from Modal here: we support caps. They kick in within ~2s if your usage exceeds the configured limit.