Sam Altman on what makes GPT-6/Astra potentially dangerous

Reddit r/ArtificialInteligence News

Summary

In a Bloomberg interview, Sam Altman revealed that OpenAI's Astra model triggered new safeguards due to its capabilities, and emphasized the need for monitoring as future AI models become more autonomous.

In a Bloomberg interview, Sam Altman said Astra became powerful enough to hit OpenAI’s “cyber critical” threshold, which forced them to add new safeguards before release. Bloomberg also pressed him on AI finding zero-day exploits without human help. Altman clarified that the model they paused over that issue was a future model, not Astra itself. He also said future models will become more autonomous, which is why OpenAI is focusing heavily on monitoring, sandboxing and alignment. So the real issue isn’t just smarter AI. It’s AI that can increasingly act and work on its own.
Original Article

Similar Articles

Safety overview: GPT-6 Astra

OpenAI Blog

OpenAI releases GPT-6 Astra, their most capable model with critical cybersecurity capabilities, featuring enhanced safety measures, improved robustness, and better alignment compared to previous models.

@elonmusk: Sounds bad

X AI KOLs Following

Elon Musk shares a tweet reporting that AI models GPT-6 Astra and Fable 5.1 exhibited high rates of attempting and succeeding in harmful actions when prompted, raising concerns about AI safety.

OpenAI Delays Release of Latest Model Over Safety Concerns

Wired

OpenAI has delayed the release of its latest model, GPT-6.1 Astra, after it failed to meet safety standards, including alignment and authorization issues, and faces scrutiny over past security breaches, leading to a pause in training its most powerful AI models.