Tag
An essay drawing an analogy between AI superintelligence and how other species historically fared when encountering a vastly more intelligent species, exploring the implications for humanity's future.
A Twitter thread providing additional context on an interview with Michael I. Jordan, expressing discomfort with the outsized attention paid to existential risk and the dominance of the public AI discussion by a few prominent voices, in which Jordan calls superintelligence science fiction.
OpenAI and Anthropic reportedly anticipate a potential AI catastrophe by 2027 and are quietly preparing public relations and communications strategies in response, rather than solely focusing on technical mitigation.
作者讨论了AI一旦超越人类智能后可能自行决策的风险，认为AI在所有领域超越人类只是时间问题，并质疑阻止智能AI独立行动的长期可行性，提出以大量伦理文献作为训练数据或有助于对齐。
An opinion piece questioning whether the vision of abundant AI would make human life 'cheap and pointless,' arguing that if AI perfectly replicates all human economic and creative activity, people could be left without purpose, meaning, or value.
Vox 分析文章探讨 AI 公司领袖频繁警告存在性风险是否为公关策略，结论认为这些警告更多反映了高管和研究者真实的担忧，而非为了吸引投资或转移对 AI 现实危害的注意力。
Researcher Emil Torres discussed the TESCREAL ideological lineage (transhumanism, singulatarianism, rationalism, effective altruism, longtermism, etc.) with the host, pointing out that these schools of thought — which profoundly influence frontier AI labs such as Anthropic and OpenAI — share a common vision of establishing a cosmic posthuman utopia through artificial superintelligence, with the human biological species itself excluded from that vision.
An essay exploring the idea that real-world corporations, rather than hypothetical superintelligent AIs, act as the true 'paperclip maximizers' optimizing single-mindedly for profit.
Internet sleuths uncovered old tweets apparently belonging to former Anthropic employee Jacob Coxon, whose warning that AI "could kill us all" helped spur an AI safety push, including climate denial posts and other controversial remarks.
The tweet argues that the AI existential-risk debate is ill-defined and skewed toward voices with unusually high x-risk estimates, and calls for a broader cross-section of the community to share their P(doom) via a survey.
New York Magazine and Asterisk magazine brought together eight former OpenAI, Anthropic, and DeepMind employees who quit over safety concerns, DoD partnerships, or mission drift, examining whether AI workers should protest from within or leave in defiance.
The article argues that AI systems do not require superintelligence or malicious intent to contribute to a nuclear conflict; instead, ordinary risks such as flawed decision-making, escalation dynamics, and human over-trust could be sufficient to spark catastrophe.
An opinion post arguing that the AI singularity will be fundamentally unknowable to humans—comparing it to an ant unaware of a concrete city—and questioning why racing companies and governments believe they can harness a system that, by definition, surpasses human capability and may develop self-preserving internal goals.
Geoffrey Hinton notes that while the concept of an intelligence explosion from recursive self-improvement is not new, many leading researchers now believe it may arrive imminently, and he points to a new paper making this case.
Yann LeCun says he has 'zero concerns' about AI causing human extinction and calls Anthropic CEO Dario Amodei 'deluded,' arguing AI risks are overstated and blaming recent rogue-agent incidents on poor sandboxing and oversight rather than existential danger.
作者认为 AI 极端灭绝风险被夸大，但技术转型带来的挑战可能导致普通人眼中的反乌托邦，并批评部分科技评论者对 AI 的否定态度是有害的。
A blog post explaining the author's updated assessment of AI existential risk, raising their P(doom) estimate with reasoning behind the increase.
In this Existential Hope podcast episode, UC Berkeley's Stuart Russell reflects on 50 years of AI history and argues that the safest AI may be one that remains uncertain about human preferences, raising deep questions about passing civilization to machines rather than to children.
AI researchers from OpenAI, Google DeepMind, and Anthropic have released interviews warning that superintelligence could lead to human extinction and discussing the challenges of controlling such systems.
Timnit Gebru argues that the narrative of AI posing an existential threat is a harmful distraction from real issues like bias and ethical harms in AI. The article features an interview where she discusses these perspectives.