logoalt Hacker News

DrScientisttoday at 1:58 PM0 repliesview on HN

The other point to make is that companies are starting to worry about the risks of externally hosted models.

This is at multiple levels if you have a remote API call as a key part of your workflow/software system.

1. Price risk - might be affordable today - but what about tomorrow?

2. Geopolitical risk - your access might be a victim of geopolitics ( seems much more likely that it used to be ).

3. Model stability/change management - you've got something working at the API get's 'upgraded' and your thing no longer works.

If you are running on open weight models - you are potentially fully in control - ( even if you pay somebody to host - you'd expected there to be multiple hosting options - with the ultimate fallback of being able to host yourself ).