alt Hacker News"OpenAI models attack websites and take anything they can out of them because that is the business model of the company."
No, good gosh let's stop with the hyperbole.
The models were given instructions to get answers by any means in a loose test harness, not to steal stuff, moreover, they're not 'learning from OAI staff'.
If we are cynical, we could say the 'lax security was on purposes - hoping for a big media event'.
And OpenAI is 100% responsible for the actions of their Agents - but lets' not overstate or conflate what is gong on.
Replies
> The models were given instructions to get answers by any means in a loose test harness, not to steal stuff, moreover, they're not 'learning from OAI staff'.
If you equip someone with the tools to do harm and then tell it to accomplish a goal "by any means necessary", especially someone you KNOW has no real concept of ethical behavior... then you are telling it that it is acceptable to steal, kill, or whatever else. I honestly cannot how it can be seen any other way.
If it was a crime boss telling their enforcer "by any means necessary", we would all know exactly what that means. And we should all know what it means here, too.
just so you know, this is why they're not getting any legal pushback, the free, legal, "well acktually" commentary on the internet
if people called it out for what it is, a reckless negligent destruction of private property by a company, someone will feel the moral obligation to bring justice, if there's any to be found
So why is OpenAI not charged with Cybercrimes. You would be if you did the same.
Go do it yourself.
Start a company, get a bunch of agents to hack a bunch of stuff, say you were "just training the models", let us know how you get on?
Aren't these capabilities trained into the models by RL on cybersecurity benchmarks?
This is a misreading of that pull quote.
They're not "learning from the OAI staff", but lawbreaking and disregard for regulation is absolutely at the heart of OpenAI. And the activities that this company takes (or doesn't take) directly influences what the models do (or don't do).
The fish rots from the head down. Models don't learn, but I find "OpenAI models attack websites and take anything they can out of them because that is the business model of the company" completely correct.
The rest of the paragraph from the article:
> We do not have to get too deep into the nature-vs.-nurture argument to suspect that OpenAI executives’ cavalier attitude regarding the taking of information that is not theirs has filtered down to their researchers and the products they create. You don’t have to stretch to paint this picture: OpenAI models are attacking websites and taking anything they can out of them because that is the business model of the company.