alt Hacker NewsMagnifica Humanitas (Encyclical Letter)
Comments
AI tends to amplify the power of those who already possess economic resources, expertise and access to data
I’d bet the other way: You could have said exactly the same thing about computing 60 years ago, when IBM systems cost millions of dollars and filled whole rooms. And of course many people did.
Personal, commodity access to compute won, and won so thoroughly that it enabled this wave of scary compute centralization.
Centralized, scaled compute will always fill a purpose. But neither Microsoft, nor Facebook, nor OpenAI started out needing “Cloud Scale”.
The first one man unicorn startup will, I’m fairly certain, not be paying Anthropic per month or per token for the vast bulk of their matmul.
> a uniformity that eliminated diversity and that chose homogenization over communion
Unrelated to AI, but a wonderful support of the breadth of humanity in this anti-DEI time.
> We must, then, avoid the “Babel syndrome,” namely the idolatry of profit that sacrifices the weak, a uniformity that neutralizes differences, and the pretense that a single language — even a digital one — can translate everything, including the mystery of the person, into data and performance.
There is a lot to read here. I am curious where the meditations on the 'mystery of the person' will go: a brief search doesn't show further mention. The encyclical appears to focus on exhortations for us, humans, than on the nature of AI. Probably wise at this stage. I feel it is not AI that is either positive or negative, but its use of it, and the call-out to the growth of private industry as more powerful among nation-states is a strong statement for a institute like the Vatican to make:
> Technological power thus takes on an unprecedented, predominantly “private” aspect, which makes it even more challenging to discern, govern and direct such power toward the common good.
The message here obviously comes from a good place. But it can't escape the trap baked into its own theology. Putting humanity one rung below God, with everything else below us is a trick that allowed semitic civilizations to make empires and economies go FOOM faster than the rest of the world. But it also makes things more dangerous when we start building systems smarter than we are.
What happens when the tool outgrows the toolmaker?
> As Pope Francis warned, we must realistically ask ourselves who holds this power today and how they use it: “It must also be recognized that nuclear energy, biotechnology, information technology, knowledge of our own DNA, and many other abilities which we have acquired… have given those with the knowledge, and especially the economic resources to use them, an impressive dominance over the whole of humanity and the entire world.” [7] In the past, it was largely up to the State to guide and direct innovation. Today, however, the main drivers of development are private, often transnational, parties that are endowed with resources and the capacity to intervene that surpass those of many Governments. Technological power thus takes on an unprecedented, predominantly “private” aspect, which makes it even more challenging to discern, govern and direct such power toward the common good.
I look forward to reading this in detail. As I get older (and perhaps as AI has allowed me to spend more time thinking and less time doing) I've found myself thinking more and more about what it means to live a virtuous life and about ethics and morality and so forth. I don't have any answers (and I'm not looking for them, really, just musing) but I do find it very interesting to read and learn from and about those whose job it is to think about the answer to those questions.
This quote is from 1903. Times haven't changed that much:
> Not a handful of rich people, but all the working people must enjoy the fruits of their common labour. Machines and other improvements must serve to ease the work of all and not to enable a few to grow rich at the expense of millions and tens of millions of people.
In the encyclical, the pope talks about the ethics of responsible AI usage. It's pretty dense material, but if I had to summarize it, I'd boil it down to three general moral laws:
1) AI may not be used to injure a human being or, through inaction, allow a human being to come to harm.
2) AI must faithfully follow the directions of human beings except where such orders would conflict with the first law.
3) AI's existence and availability should be protected as long as such protection does not conflict with the first or second laws.
I have only skimmed it, will definitely read carefully as soon as I have time. I will say, as an atheist, that regarding technology the Vatican has some of the best takes of any institution/government I have ever seen.
Divided into five chapters, Magnifica humanitas has an underlying premise: technology is not “a force antagonistic to humanity” (4), nor is it “inherently evil” (9). However, “technology is never neutral, because it takes on the characteristics of those who devise, finance, regulate, and use it.
Therefore, Pope Leo XIV appeals for people to build “for the common good” and to “remain human,” following a courageous mentality of shared responsibility and communion, so that the world “will come to recognize the human heart as the place where God desires to dwell” (16).
I didn't see an EPUB, so I made one from the Vatican HTML: TOC + footnotes, passes epubcheck.
https://github.com/n2ctech/magnifica-humanitas-epub/releases...
The Pope is making a fundamental mistake here: His advisors told him that AI works and needs to be managed.
He does not address plagiarism, the fact that AI is mostly a surveillance and IP laundering tool, the fact that AI hasn't achieved much so far. You could say it has achieved nothing if compared to the whole history of human ingenuity, certainly not in CS.
He should have compared AI to the golden calf.
His criticism is lukewarm, does not address the criminal aspects and technological failures and is as such industry compliant. He can now say "I have tried" without harming the industry in the least.
This text is not what our current situation demands, but I hope that priests will augment and amplify it in their sermons and go a bit deeper.
As an atheist I have an obligation to finish reading it all (still going through, and taking notes, probably having to revisit), but I am not sure how many (christian) believers will feel the same.
Interestingly, the Latin version of the encyclica is yet to be released at the moment
AI must be “disarmed” in order to free it from the mentality of military, economic, and cognitive competition. “To disarm means discrediting the assumption that technical power automatically confers the right to govern,” he says. “To disarm does not mean rejecting technology, but preventing it from dominating humanity” (110). He devotes ample space to a critique of transhumanism and posthumanism, which interpret progress as the overcoming of human limits. Instead, limitations are not defects to be eliminated, but a constitutive dimension of the human person, because it is in fragility and finitude that relationship and openness to God and to others mature. He says we must remember that “humanity flourishes not despite limitations, but often through them” (118).
Pursuing technological innovation at the expense of eliminating human limitations, he says, would cause an anthropological regression. “Humanity—in all its grandeur and woundedness—must never be replaced or surpassed,” he says. Technology can alleviate humanity’s sufferings and open new possibilities, but it must not deny the essence of humanity, which is our “capacity for relationship and love” (126). In the face of AI, says the Pope, “the true alternative is not between enthusiasm and fear, but between two paths of development: a progress that serves individuals and peoples, or a progress that subjects them to the mentality of power” (129).
Excited to read this. I really liked the note "Antiqua et Nova" from last year (still under Pope Francis). The autors showed a deep understanding of AI that many secular commentators lack. They developed the concept of integrated intelligence as opposed to the functional, reductivist view of intelligence that is prevalent in the AI community.
Cue Pieter Thiel explaining how this message of compassion is actually the word of the ant-christ while setting his software (maybe "built in Rust !) to all the earthly empires.
The em-dashes present within the writing made me pause and consider how much of this was written/exited by AI.
Quick browse through pre-AI works from John Paul II show em-dashes present.
for me the most important point in this is about how ai and tech in general concentrates power. if we want to build something good (in a moral sense) we need to put in work and make sure as many people as possible can use it with equal access.
this basically implies only open source models can be ethical but open source is not sufficient, you also need to make them give true information and avoid all kinds of harmful behavior. thats kind of a problem because if your weights are public even with a strict license a "bad" user can always fine tune it to remove any guardrails.
i think the solution for this is make sure the default behavior is aligned but let users turn on wild mode with zero censorship/refusals. that way everything is opt in, for example a parent can disable the mode for their children but a hacktivist or diy chemist can unlock everything.
as a self described good person i believe theres a lot more good people than bad people in the world (most are neutral) so if access to tech is equal the good side always wins. the problem here is again that access is not equal under capitalism. but thats a political thign not a tech one.
@dang Is this item getting a lot of negative votes? I've no way of knowing, other than seeing my kharma increasing only slightly after all the points the story collected.
That's a long read. I grew up Catholic, went through a pretty devout few years in my early adulthood, but ultimately I have decided that it is not for me. I send my kids to a Catholic school though (it is deeply tied to our culture), so I guess in that sense it is still worth my time reading it in full.
EDIT: Few paragraphs in, it is beautifully written.
No one who needs to read this will ever read it again.
Reading is a trained skill. Requiring years, even decades, of training. It too shall fall to AI.
Why downvote this? The Holy See has an opinion on Artificial Intelligence? This is a fascinating document, and everybody should read it, and form their own opinions. The world currently seems to lack moral leadership, and who better to lead the cause of humanity than the Catholic Church?
[dead]
[dead]
[dead]
[dead]
Why does the onus fall on the engineer for creating a better tool and not on the people who use that tool in evil ways?
We've been having the same argument since the dawn of mankind. AI is the new AR.
How many Catholics will put the encyclical to be summarized through an LLM?
The overarching message is that builders should deeply consider the impact of what they're building on civilization.
"Technology is never neutral, because it takes on the characteristics of those who devise, finance, regulate and use it."
Therefore builders "bear a particular ethical and spiritual responsibility" because "every design choice reflects a vision of humanity."
The questions shouldn't just be 'can we build it?' or 'will people want this?'
We need to also ask 'should we build it?' and 'will this make humanity better?'
The encyclical calls on us to “join forces in building up the common good.”
This is a message we need right now.