logoalt Hacker News

layer8 • today at 3:17 PM • 4 replies • view on HN

It would be sad if AI designed and built the Saturn V and we had it fly us to the moon without understanding the details of of how it is built and how it works. There is furthermore value for humans in going through the discovery process themselves, not just value in getting to the moon. So I understand how one can be sad if that won't happen anymore now, and instead humans are relegated to analyzing what the AI designed and built.


Replies

ChicagoBoy11 • today at 3:29 PM

But to extender your analogy: We do understand how Claude does what it does and how it is built, so how is this different?

➕ show 5 replies
larsfaye • today at 4:29 PM

We already had AlphaFold, which "solved" the protein folding problem, but scientists readily admit that they know next to nothing new about the field, despite it being accomplished.

zoeysmithe • today at 4:16 PM

I mean computers made Apollo work. They couldn't get it done with human paper calculation. The lander itself had a processor in it. So its kinda the same thing. "Humans should have done this by hand," is just an odd thing to want and ties back to some really backwards thinking. These are our tools. No one is expecting us to make homes without power tools or walk for miles instead of taking a train. At a certain point AI will be normalized and we'll have actual critical takes on AI that make sense other than "Well, I just don't like it for vague human achievement reasons." The same way people complaining about 1980s cars getting "computer chips" and "no longer being able to hand tune my carbonator" have long accepted more complex and automated and computerized cars.

As far as not knowing how it works, that becomes a bit of a philosophical problem. We know how LLMs work and their algorithms. I think we can always play up "we don't know" is disingenuous ways. How many people who made Apollo calculations could also write long proofs and theorems of the fundamental maths they were using from first principles? Not a lot. We're always standing on someone else's shoulders. We'll never truly know everything or how exactly our tools work on an individual level. Maybe AI changes things because an innovation may not have a direct line to an Isaac Newton at its base, but I think that's a bit of a vague and poetic difference, and not a real one. Its still human achievement but via machinery.

I dunno, its a bit scary, but I do feel like its just continuing the same line of human ingenuity. Not knowing exactly how something came about and non-determinism scares some people, and perhaps rightly so, but pretty much all major technological advances are scary on some level because they so strongly challenge the status quo and our ways of thinking and or ideas of what is good and right and proper. At a certain point, its hard not to see the more dramatic AI outrage as just hysteria and moral panic. I find it interesting how easily we can spot moral panics in the past in history, but when its our turn, it can be very hard to see when we're in a moral panic. To many living during those times, the moral panic sounds entirely reasonable, but its still a moral panic.

techmunky • today at 5:33 PM

And if the rocket failed at any point nobody would know how to fix it. Only the AI guessing and saying "you're right to point that out" when the rocket explodes and everyone inside perishes.