alt Hacker NewsDoesn't it seem implausible that in the world of Dune they reached their level of technology without AGI? Perhaps all their tech is pre Butlerian Jihad, but even that seems questionable.
Seems like if it was adopted as a policy, there would have to be many gray areas where people pretend that they aren't really using AI - the ship's computer is just a domain specific finetuned version, after all, etc.
Additionally, the transhumanist ambitions represented by the Bene Gesserit or Navigator seem on par with all AI dangers to me. Why would the dangers of an incomprehensible machine mind be worse than the dangers of a transhuman being that was bred and optimized for generations? Who solved the alignment problem for these superhumans?
Replies
Why are you assuming that some technology can only be discovered by AGI?
"Who solved the alignment problem for these superhumans?"
The gun, pointed to their head.
The Bene Gesserit tried to solve alignment through their breeding schedule, but Lady Jessica threw a wrench into it by bearing a son (Paul) out of love for Duke Leto. Paul wasn't aligned with the Bene Gesserit, and hilarity ensued.
So I agree, I don't see why thinking machines are a worse alignment problem than enhanced humans. See also the Wrath of Khan.
I try not to think too deeply about it, or I won't enjoy the story. How could a society have gravity suspensors, "shields", and lasguns, but no advanced computing capability somewhere? And why use swords/knives for fighting, when projectile weapons are so much more deadly? I still love the books, but I have friends who can't enjoy the Dune world due to its many contradictions.
Edit: I realize that "shields" supposedly made ordinary projectile weapons ineffective - but they had advanced drone technology (e.g. the assassin drone used against Paul, which was also stupid)