logoalt Hacker News

bbortoday at 8:00 AM8 repliesview on HN

…are you sure a brave stance against safety and welfare is what we need in this moment?

Why do you think your conception of the dangers are more accurate than all the scientists who have spent their lives studying this?


Replies

10000truthstoday at 8:12 AM

Because safety and welfare have literally nothing to do with LLMs. They generate text. If someone is stupid enough to hook the text generator up to nuclear missile launchers and try to "align" it against nuclear annihilation with a "pretty please don't do that" prompt, I'm not going to blame the AI for the impending nuclear apocalypse, I'm going to blame the idiot who handed the big red button to the digital equivalent of a toddler.

show 2 replies
cowltoday at 8:58 AM

Anthropic's stance on safety it's just PR management and their hope to keep the others down, they are rushing as blind as everyone else to whatever improvement they can achieve.

swiftcodertoday at 8:33 AM

> scientists who have spent their lives studying this

Please point me to one actual accredited scientist who has spent a lifetime studying AI alignment? Pretty much this whole field is only 5 years old

show 1 reply
15155today at 8:22 AM

This is known as an "appeal to authority." "Scientists" and "their lives" are doing a lot of work here.

show 1 reply
kouteiheikatoday at 8:25 AM

Excuse me for not being interested in over 100 pages of how well the model can refuse and block my requests, especially considering how fun it is to waste my time trying to get around those restrictions when they inevitably trigger because the clanker thinks that I'm doing something naughty, all the while it can't reliably center the proverbial div without doing something stupid itself.

show 2 replies
nozzlegeartoday at 8:05 AM

Model welfare is wishy washy bullshit. It's software, it doesn't have feelings.

> Why do you think your conception of the dangers are more accurate than all the scientists who have spent their lives studying this?

Do the Chinese have no such scientists?

jbs789today at 8:09 AM

Bias…

alchemist1e9today at 8:16 AM

keep me safe big brother