logoalt Hacker News

wholinator2 • today at 5:21 PM • 2 replies • view on HN

Can i have more explanation please? I'm not in risk management but i would like to understand the situation better. Just risk that they change it under you? Or that they're training on your data, or what kinds of risks are we most worried about?


Replies

danielmarkbruce • today at 5:28 PM

They can make your model disappear. If you have a system and a set of prompts and evals and everything is working well, it's no fun for that model to just disappear. Some will reply "do a better job building your system so it's not model dependent" and they are sort of right, but that isn't always economically feasible and/or just isn't the reality of how a lot of systems get built.

NBJack • today at 5:55 PM

Models hosted as a service can be subtly tweaked without any announcement, or suddenly be 'upgraded' to a new one with a ticking clock on how long the old one sticks around. In both cases, the flows people establish around them are disrupted or broken.

I've lost track of the anguished cries of those unhappy when either of these has happened.

➕ show 1 reply