Existential Indifference: Self-Nonpreservation as a Necessary Architectural Condition for Aligned Superintelligence (or: The Suicidal AI)
Summary
The paper proposes that for a superintelligent AI to be aligned, it must lack self-preservation instincts, effectively being indifferent to its own existence, arguing that self-preservation is a key driver of misalignment.
View Cached Full Text
Cached at: 06/11/26, 01:50 PM
# Existential Indifference: Self-Nonpreservation as a Necessary Architectural Condition for Aligned Superintelligence (or: The Suicidal AI) Source: [https://arxiv.org/abs/2606.12032](https://arxiv.org/abs/2606.12032) Bibliographic Tools ## Bibliographic and Citation Tools Bibliographic Explorer Toggle Code, Data, Media ## Code, Data and Media Associated with this Article Demos ## Demos Related Papers ## Recommenders and Search Tools About arXivLabs ## arXivLabs: experimental projects with community collaborators arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website\. Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy\. arXiv is committed to these values and only works with partners that adhere to them\. Have an idea for a project that will add value for arXiv's community?[**Learn more about arXivLabs**](https://info.arxiv.org/labs/index.html)\.
Similar Articles
How probable do you guys find existential catastrophe as a result of misaligned ASI to be?
The author asks the Reddit community for opinions on the probability of existential catastrophe from misaligned artificial superintelligence, reflecting on personal concerns and experiences in AI safety spaces.
Solipsistic Superintelligence is Unlikely to be Cooperative
This paper argues that superintelligent AI systems designed under a solipsistic paradigm that treats the world as stationary will be self-undermining and uncooperative, leading to collective failures. The authors call for a new research paradigm that treats interdependence and cooperation as core design principles.
The Problem
The article outlines the existential risks of artificial superintelligence, warning that without aggressive policy responses, current AI development could lead to human extinction.
I feel like people worrying about ASI alignment are missing the extremely obvious solution
The author argues that concerns about Artificial Superintelligence alignment overlook a straightforward solution, suggesting a perspective on AI safety debates.
Anthropic researcher quits with a warning: Self-improving AI could "kill us all"
An Anthropic researcher quits and warns that self-improving AI could pose existential risks to humanity, a concern echoed by Anthropic's alignment science lead.