alt Hacker NewsThe value in this really is running small custom models or the absolute latest open weight models.
Why bother when you can get payg API access to popular open weights models like Llama on Vertex AI model garden or at the edge on Cloudflare?
The value in this really is running small custom models or the absolute latest open weight models.
Why bother when you can get payg API access to popular open weights models like Llama on Vertex AI model garden or at the edge on Cloudflare?
Custom models.
We use this, pretty convenient and less hassle than managing our autoscaling GPU pools.