logoalt Hacker News

mushufasatoday at 8:04 PM2 repliesview on HN

I would love for things like this to be accessible via hubs like open router or AWS bedrock. It's hard to justify adding new model vendors directly with all the heightened concerns about privacy and security, but if bold new capabilities are added to a centralized already-vendor like AWS, technical people can adopt them without going through a whole compliance/purchasing/vendor review process. And an extra middleman tax is well worth it when the cost savings of the model itself can be one-two orders of magnitude.


Replies

cheezetoday at 8:19 PM

Isn't openrouter the exact opposite of caring about security and privacy?

I guess you can choose your provider still? But isn't the point that the lowest bidder is doing inference?

show 2 replies
obliotoday at 8:13 PM

The thing is, in this climate it's hard to believe such tech will remain secret for long.

So, assuming this is not vaporware, this would raise the tide for everyone because it shows what's possible.