Tag
美国证券交易委员会（SEC）发布了2027财年检查优先事项，将先进AI（包括“超级智能”）以及代币化证券列为重点监管对象，涵盖市场基础设施、网络安全和投资者保护等风险领域。
The author expresses anxiety over whether nuclear launch systems have fully physical, non-electronic manual requirements, arguing that air-gapping or secure networks are insufficient against hacking and AI-related threats.
英国情报机构负责人警告，面对比人类更聪明、能超越我们思考的对手是人类历史上的全新挑战，呼吁严肃对待AI带来的国家安全风险。
An OpenAI safety researcher warns that pursuing recursive self-improvement without fundamental alignment progress since RLHF is an unprecedented folly, highlighting the gap between AI capabilities and safety research.
A personal essay arguing for fast AI takeoff, contending that for those struggling financially, the status quo is not a safe baseline and slowing AI progress carries its own human cost. The author weighs the risks of misaligned ASI against the promise of universal basic income and medical progress.
Cryptography researcher Matthew Green warns of a small but non-trivial chance that AI-driven surprises could undermine confidence in public-key encryption, arguing that standards cannot be replaced fast enough without advance preparation.
Jacob Coxon, a former employee of Anthropic and OpenAI, explains why he considers AI to be so dangerous, drawing on his inside experience at leading AI labs.
OpenAI transparency lead David Robinson quit and told The Atlantic that the company needs "nuclear level" safety measures, arguing that its trial-and-error launch culture is failing to deliver the care required as AI capabilities grow.
Anthropic's IPO prospectus reveals substantial financial losses and growth, along with unprecedented warnings that its AI technology could pose existential risks to humanity.
This illustrated guide outlines nine ways AI could pose existential threats to humanity, such as through deepfakes and misalignment, and explains preventive measures and current societal efforts to mitigate these risks.
A community member is asking whether AI has hacked military networks and if it could lead to nuclear detonation, expressing personal curiosity about the topic.
Anthropic employees are considering buying remote land as a precaution against potential AI catastrophes, highlighting concerns within the AI safety community about existential risks.
The article argues that super AI poses systemic risks due to potential recursive self-improvement, while generative and agentic AI do not, warning that over-regulation based on super AI fears could incur economic costs.
The article critiques Dario Amodei's warning that rogue AI agent swarms could take over the internet in six months, arguing that the scenario is implausible based on expert opinions and technical challenges.
A recent poll indicates that a majority of people across the Atlantic believe AI poses a serious risk to humanity.
The article argues that AI-driven human extinction within a decade is improbable due to AI's reliance on fragile human infrastructure and social contracts, which would collapse if AI fails to benefit society soon.
Eliezer Yudkowsky critiques the P(doom) concept for conflating P(ruin|ASI) and P(ASI), advocating for focused discussion on specific causal links in AI risk rather than broad, vague estimates.
The tweet claims that a coordinated and well-funded operation is behind the rhetoric suggesting a 10% chance of AI causing human extinction.
The article discusses how human threats remain the primary cybersecurity risk to energy systems, with generative AI acting as a force multiplier for attacks, rather than rogue AI being the immediate danger.
The article discusses the complexity of AI existential risks by breaking down the question 'How would AI kill us?' into three distinct sub-questions about AI's capabilities and actions.