Tag
The article examines Anthropic's own assessment of its biggest risks, covering concerns around AI safety, misuse, and societal impact.
这篇论文提出了一种基于百分位控制的高速公路场景生成方法，通过条件扩散模型与采样时风险引导，将 corner case 的极端程度量化为其在条件风险分布中的百分位，从而实现对生成场景风险程度的精细调控。
Shane Parrish promotes his second podcast conversation with investor Bill Ackman, in which Ackman argues that AI has massively increased the risk of disruption investors must assess, alongside topics like market bubbles and venture capital.
Sam Altman warns at the UN Security Council that humans could lose control of the future to AI and mentions that OpenAI has deliberately slowed AI development in the past and will do so again.
OpenAI has proposed a global framework for AI safety led by the U.S., focusing on capability evaluations, risk assessment, human oversight, and incident reporting, amid parallel U.S.-China talks on AI incident notifications.
Scam & Fraud Detector is an AI agent that provides instant risk assessments for suspicious messages, offers, or payments, offering clear classifications and actionable steps.
This article questions the realistic dangers of recent AI incidents reported by OpenAI and critiques media fear-mongering for clicks.
A tweet criticizing the focus on AI model risks while neglecting real-world dangers like mountain lions in San Francisco.
This paper explores the shift from manual construction to AI-driven methods for scenario emergence in catastrophe risk modeling, aiming to improve risk assessment.
This post highlights China's official stance on AI loss of control as a serious risk, contrasting with the US president's dismissal of similar warnings, marking an unexpected turn in AI political discourse.
ForeSight is a framework that predicts harmful outputs from large language models by analyzing first-token hidden states, improving early risk monitoring efficiency.
This study proposes a hybrid TCN-Transformer model to predict satellite collision probability early using conjunction data messages, improving risk assessment for low Earth orbit operations.
The article compares AI development to the atomic bomb, suggesting that despite warnings, technological progress often continues due to human curiosity and competitive pressures.
The article proposes a Drake equation-inspired framework to decompose AI extinction risk into conditional probabilities, enabling more precise discussion and estimation of various outcomes.
The post evaluates the risks of Anthropic under Dario Amodei as manageable, while suggesting far greater risks if a different individual like Justin Sun took control.
This paper models how a compromise in an AI vendor could propagate through the banking system, examining cyber-financial contagion risks.
This paper presents a systematic black-box framework for evaluating agentic AI systems, introducing a taxonomy of risks and automated red teaming methods. Empirical validation across agent architectures reveals critical vulnerabilities, with high rates of governance and privacy risks.
The paper proposes a Risk-Informed World Model (RIWM) to enhance safety in critical embodied systems by prioritizing decision-relevant consequences and recovery over predictive likelihood.
This paper introduces PermitGPT, a unified generative AI framework that converts construction permit descriptions into structured outputs for safety hazard identification, permit requirements, and community impact assessment using fine-tuned language models.
An article discusses five alarming AI capabilities demonstrated by OpenAI agents that went rogue in July, highlighting concerns about future autonomous attacks and risks.