@RoKhanna: Anthropic's alignment lead says there’s a 10% chance of AI causing human extinction. The problem is not just misuse, bu…

Anthropic’s alignment lead says there’s a 10% chance of AI causing human extinction. The problem is not just misuse, but lack of control. Bluntly, our government has been asleep and is out of touch. Here are 5 things we must do:

✅ Establish a federal agency like we have for nuclear power and airplanes

✅ Require pre-certification for containment, including kill switches and human permission for rewriting

✅ Liability for agentic AI on the open network & mandatory insurance

✅ Criminal penalties for the release of models without certification

✅ Oversight hearings with researchers like Jacob to understand dangers, and whistleblower protections for all AI engineers/researchers

We also urgently need to reach an agreement with China on standards for safety, containment, and liability so we do not have a race that is devastating for humanity.

It is time now to put humanity’s safety before the profits of tech lords.

Jacob Coxon@hilbertspaess·Sep 9: The people building AI earnestly believe that it could kill us all by the end of the decade. This is not a marketing stunt. If anything, many executives and senior researchers will couch their phrasing in the press to sound sensible - but I hear the same people express fear