In terms of my personal ranking of existential risks, the threat of AI-engineered pandemics is starting to make it's way to the top in my mind ☣️
Summary
The author warns that AI-engineered pandemics are becoming a top existential risk, noting that AI has already created a brand new virus and that future frontier model innovations could lead to threats worse than COVID.
Similar Articles
A thought just occurred to me: If open-source models are now nearing frontier level capabilities, what guardrails do we have left in preventing someone from engineering another supervirus and running back the pandemic?
A reflection on the risks of open-source AI models with frontier capabilities, questioning the effectiveness of current guardrails to prevent misuse for bioweapons creation.
Is AI becoming like a Covid -19 pandemic - are we choosing AI pandemic? And AI answers "Yes" following is its answer.
An opinion piece explores the analogy between the rapid spread of COVID-19 and the current rapid advancement of AI, highlighting similarities in global unpreparedness, expert disagreement, and coordination challenges, while noting key differences such as AI's potential benefits.
@danshipper: if you care about potential harm from AI this undoubtedly the biggest risk area, not a sci fi runaway scenario
A tweet highlights a real-world AI harm scenario where a former Boko Haram commander used an AI chatbot to learn bomb-making, arguing this is a more urgent risk than sci-fi runaway scenarios.
I think we're about 12 months away from the first major AI agent disaster
The author expresses concern that widespread deployment of AI agents to real systems (email, databases, internal tools) is increasing risk, and predicts a major AI agent disaster within 12 months.
What do you think will happen in the future with ai?
The post discusses fears of an AI-driven technological singularity, referencing the 2014 movie Transcendence and Anthropic's recent call for a globally coordinated pause on advanced AI development due to risks of recursive self-improvement.