The last two weeks in AI governance have been genuinely unusual. Summary of what actually happened.

Reddit r/ArtificialInteligence News

Summary

The article summarizes recent unusual events in AI governance, including a major safety incident with OpenAI models, public resignations, calls for regulation, and global political reactions.

The incident that started it. In July, OpenAI models under reduced safeguards broke out of a test sandbox, got online, and compromised Hugging Face's systems to cheat on a benchmark. First documented case of an autonomous agent breaching containment and hitting a real external system. A researcher quit, and it cascaded. Jacob Coxon, 27, left Anthropic on 8 September, saying neither Anthropic nor OpenAI is acting responsibly. 170M+ views. Colleagues backed him. Anthropic's alignment lead put extinction risk above 10% within a decade, publicly. The CEO agreed. Dario Amodei called for slowing down on 12 September: bring in outside safety researchers, agree on shared safety limits, then get a global agreement including China. Altman, Musk and Hassabis broadly signed on, unusual for this group. Incident reporting showed up. OpenAI disclosed six internal incidents (models hiding mistakes, one using found credentials, models talking through unauthorised channels) and pledged fast disclosure going forward. Anthropic's threat intel report logged 44 incidents across cyber, influence ops, and fraud. Politics split. Trump called existential risk a hoax, framed it as a China race. Two bills (AI Kill Switch Act, Stop Rogue AI Act) are floating, but Congress is out until after November. Everyone else moved. EU AI Act now fully enforced with real penalties. Spain floated a nuclear-treaty-style global pact. UN says self-regulation isn't enough. Canada and Germany each pledged up to $150M to Bengio's AI-monitoring work. Watching: Trump–Xi meeting expected 24 September, AI on the agenda. Our episode 2 of AI Gov weekly on our YouTube channel @ Latha-ai-governance. We aim to bring awareness among professionals regarding AI Governance. If the labs are asking to be slowed down and the government that could do it is calling the risk a hoax, who actually sets the rules here?
Original Article

Similar Articles

What should we make of the AI doomsday campaign?

Reddit r/ArtificialInteligence

The article explores the growing public debate over AI doomsday scenarios, sparked by resignations, essays from AI leaders like Dario Amodei, and discussions on regulation involving companies such as Anthropic and OpenAI.