I wonder if they'll continue to support and develop Cog [0], which I've found quite useful for local deployments of models (as well as to Replicate's servers).
The one time I’ve interacted with cog, predictably, it delivered none of its benefits compared to a vanilla pyproject.toml, and all of the downsides of being, ironically, not replicable.
The one time I’ve interacted with cog, predictably, it delivered none of its benefits compared to a vanilla pyproject.toml, and all of the downsides of being, ironically, not replicable.