logoalt Hacker News

First phase of embedded assessments at OpenAI

37 points • by dvaplima • yesterday at 4:07 PM • 15 comments • view on HN

Comments

vessenes • yesterday at 8:50 PM

We're in a surprising narrative where Anthropic is pushing forward and oAI is slowing down for safety reasons.

There's a pretty interesting matrix of possibilities here if you consider who has better mechinterp, if that's actually helped alignment, and what the internal drumbeat is around cash and IPO.

If you think your safety problems are existential, then you MUST halt and do all this. And, if you think someone else's safety problems might kill them, suddenly, without warning, then you have time to slow down and do this right.

I think if I had to pick a company to be in charge of, I'd pick Anthropic right now, given only an outsider perspective. But, I can see a lot of reasons why being a fast follower around IPO time might give comfort. Anyway, I'm interested to see some debriefs in the next few months as to what's actually going on right now, and see what the next oAI model quality is like. We may well see some pulling away from one or the other group in the interim. And it could well be oAI.

➕ show 3 replies
mentalgear • yesterday at 7:44 PM

Can't we just use the nane 'on-site' : it's a lot clear and comes without the baggage of the military-derived 'embedded' term.

➕ show 2 replies
petesergeant • yesterday at 7:43 PM

I’m sure people will pick holes in this, but it’s hard for me to see this negatively

e12e • yesterday at 8:49 PM

This is so backwards and guardedly formulated that at first I thought it was something like the Google box (Google Search Appliance (GSA)) - for AI - that openAI were deploying agents (of the AI kind) to audit companies.

That might have been interesting.

But this is basically a hobbled external audit?

➕ show 1 reply
aetherspawn • yesterday at 8:48 PM

Yes that’s nice that you’re thinking long term about these things, but we just want to know: how far off is Astra 6.2? I’m sick of paying exorbitantly for Fable 5.2

mvkel • yesterday at 7:40 PM

It seems that post-hugging-face-incident, OpenAI has become a culture of safetyism, rooted in fear of public backlash.

The problem: anthropic has had this culture from the start, and they will deorbit all of the surrounding safety talent into the company, leaving OpenAI on the back foot in perpetuity.

OpenAI's original techno-optimist culture is what had them in front, and it was a core differentiator.

I'm not sure I'm excited about two firms playing alignment gods. One is convinced they are bringing in a new, correct god; the other is terrified that they may accidentally birth one in any capacity.