Upping my P(doom), explained.
Summary
A blog post explaining the author's updated assessment of AI existential risk, raising their P(doom) estimate with reasoning behind the increase.
Similar Articles
@julien_c: What's your P(doom)? AI Safety is an important subject, but existential-risk debate is ill-defined, and dominated by hi…
The tweet argues that the AI existential-risk debate is ill-defined and skewed toward voices with unusually high x-risk estimates, and calls for a broader cross-section of the community to share their P(doom) via a survey.
P(doom)
This article discusses P(doom) and reactions from AI leaders Dario Amodei, Sam Altman, and Elon Musk regarding AI risks, highlighting concerns about pacing AI development and its societal impact.
@ESYudkowsky: There's a lot of reasons I hate the "P(doom)" concept, but one of them is that it conflates P(ruin|ASI) and P(ASI). P(r…
Eliezer Yudkowsky critiques the P(doom) concept for conflating P(ruin|ASI) and P(ASI), advocating for focused discussion on specific causal links in AI risk rather than broad, vague estimates.
How seriously are taking the risks?
The author raises concern about AI existential risk, arguing that the popularity of the term 'p(doom)' and warnings from Nobel laureates about a 10-20% chance of human extinction warrant serious attention beyond skepticism of AI CEOs.
@dhh: The p(doom) discussion gets all the headlines, but the p(abundance) scenery is far more like and deserves much more eng…
A tweet by @dhh highlights that the AI discussion around p(abundance) deserves more attention than the often-headlined p(doom).