logoalt Hacker News

hackyhackytoday at 3:12 AM7 repliesview on HN

tldr: many great scientific advancement were created by well-intentioned researchers who were subsequently shocked to find their work applied to military, often to the great detriment of mankind.

The unwritten implication is that this applies to AI, as well. I find it hard to disagree. I don't know what to do about it.

The HN crowd is elated that we can finally finish our side projects, while the ruling class is already using AI to subvert democracy, spread misinformation, and develop weapons. "If we don't build these weapons, someone else will." If we can learn nothing else from history, we should learn that you can't turn back the clock.


Replies

3836293648today at 4:41 AM

No, this does not apply to AI because they're not well intentioned and very open about it.

lich_kingtoday at 3:47 AM

I think both things can simultaneously be true. There is a certain inevitability to technological progress. Once you reach a critical mass of collective knowledge, the resulting "thing" will get developed. If not by you, then by someone else.

But also, inevitability is not an argument for complicity. If you personally decide to work on bioweapons, I don't think you can shrug and say "eh, it was going to happen either way". As tech workers, we've really mastered the art of coming up with justifications for what essentially just boils down to "all my friends have gotten rich and now it's my turn".

I've met hundreds of sharp engineers from Facebook, Google, Microsoft, etc. None of them could look me straight in the eye and say "yeah, you know, what we're doing with ad tech is actually good". They just always had an explanation along the lines of "it's not that bad, and besides, if we don't do it, someone else will, and we're the good guys here".

show 1 reply
vlovich123today at 4:42 AM

That’s a weird tldr and not my takeaway. More like “scientists convinced their new ultra destructive weapon is sure to bring about peace this time around”. Spoiler: it does not. Arguably maybe nuclear weapons but even then I’d say the use of nuclear weapons in armed conflict hasn’t really been tested yet and people are generally hesitant to do so, preferring instead illegal chemical and biological warfare.

6177c40ftoday at 3:21 AM

Reminds me a quote from Gibson's Spook Country: "That's something that tends to happen with new technologies generally: the most interesting applications turn up on the battlefield, or in a gallery."

godelskitoday at 5:21 AM

  > The HN crowd is elated that we can finally finish our side projects, while the ruling class is
happy that they can finish their side projects too.
nwhnwhtoday at 5:11 AM

If you wanted the core of all of this... Check this book "Irrational Man" by William Barrett.

porridgeraisintoday at 8:19 AM

> were created by well-intentioned researchers who were subsequently shocked to find their work applied to military

oh please.

Most scientific development especially root-node stuff has been funded and kick-started by the military for centuries. You can't take funds from DARPA and then be shocked to see the air force using it. You can't work at ecole polytechnique and be shocked to see your work being used in libya.

Humans would have never gone to space [as quick and as at much scale as they did] if they didn't want spy satellites and ICBMs.

Shannon invented a whole new field while working with money earmarked for cryptography work in WW2.

Machine translation was first posed and funded by anyone for russian-english translation - 1949 Warren Weaver memo at the Rockefeller Foundation.

Do see my other comment for more examples.

https://news.ycombinator.com/item?id=45364917

https://news.ycombinator.com/item?id=45365211 [Context: the creator of waymo was the winner of that challenge]

And need I mention the internet itself...

As the first comment I linked mentions, even many medicines were developed only cos soldiers were dying in theater, not because normal people were dying at home. So it's not just limited to tech.

> the ruling class

No, we don't get to deflect blame like that. If we take money from DARPA/similar to invent something, we are part of the system and are responsible. Everyone involved in the space race in the 50s, Transit (sat nav) in the 60s knew it was to make ICBMs. The creator of waymo surely read that DARPA document I linked in my second comment. And need I mention that oppenheimer knew why nuclear energy was being harnessed :) You can't "oh the evil few tricking the innocent majority, what ever will they do" it away.

A logically defensible position might be that you agree that war is a timeless motivation and that you are fine with stuff being used for military purposes and continue to develop the technology with government money, OR not taking any money from the government. There are not that many others that aren't hypocritical.