A commentary argues that papal rhetoric on AI should shift from hypothetical structural solutions to directly addressing the leaders of frontier companies and nations who hold decision-making power, given the concentrated control over AI development.
Here is a view, occasioned by the papal encyclical, that I'm throwing out as a rough thought because it could be wrong. The default of papal rhetoric is to speak about global issues in terms of structures and systems rather than specific leaders or nation-states. In the new encyclical's call to gentle and restrain A.I., e.g., the consistent idea is always that we need "clear criteria and effective oversight" by some kind of neutral transnational authority, details TBD. There are reasons for this rhetorical mode beyond the Church's longstanding internationalist disposition: A rhetoric of structures and systems avoids a risky personalization of politics, where you seem to be "calling out" individual governments or actors. But it also comes with the risk of sounding utopian and irrelevant under 21st century conditions, where vis-a-vis Artificial Intelligence, in particular, a really narrow set of actors -- the governments of China and America, the leaders of the frontier companies -- are carrying almost all the decisionmaking weight. It seems like in this environment we are a bit closer to a medieval model where the Church is arguably the only transnational organization of great moment (certainly Pope Leo has demonstrated that many people are *very* interested in what Rome has to say about A.I. whereas no one would care if the UN dropped a big document on the subject), and the Vatican is in the position of arguing with and cajoling a set of princes, corporate and dictatorial and democratically elected, whose personal choices are likely to decide the direction that this tech takes. (As in, for instance, the ongoing argument inside the Trump White House about its un-issued A.I. executive order.) I wonder if papal rhetoric might usefully adapt to this reality -- not by calling out Trump or Xi or Sam Altman or Dario Amodei by name, or not necessarily, but by offering more explicit advice to today's leaders and their advisers about their unique power, the moral obligations that come with it, and the judgment of God that awaits if they get things badly wrong. You can draw some of that out of Vatican documents right now, but the balance always tilts toward hypothetical structural solutions. I think where we are, and where we might be going -- for instance, toward choices about A.I. made under conditions of greater acceleration and potential crisis -- there is a case for treating the actual deciders as the crucial actors rather than always imagining an entirely different world.
David Sacks warns that government control over AI development could lead to censorship and surveillance, referencing Orwell's 1984 and the ancient question of who guards the guardians.
The author reflects on Pope Leo's encyclical about AI and the labor market, arguing that while historical trends suggest AI may not cause mass unemployment, extreme scenarios could lead to loss of human agency, and that banning AI is impractical while market-based solutions are unclear.
The Pope released a 42,000-word document arguing that AI ethics require legal frameworks, not just self-regulation by private companies. Anthropic co-founder Chris Olah agreed, highlighting the need for external oversight.
Anthropic co-founder delivers remarks at the Vatican's Magnifica Humanitas, calling for broad societal involvement in shaping AI's future and highlighting three key questions for discernment, including duty to the global poor.
Pope Leo XIV released an encyclical titled 'Magnificent Humanity' warning that opaque algorithms run by a few powerful firms risk new forms of dehumanization. He called for robust legal frameworks and political involvement to regulate AI.