OpenAI proposes a regulatory framework for 'frontier AI' models that pose potential public safety risks, advocating for standard-setting processes, registration/reporting requirements, and compliance mechanisms including pre-deployment risk assessments and post-deployment monitoring.
# Frontier AI regulation: Managing emerging risks to public safety
Source: [https://openai.com/index/frontier-ai-regulation/](https://openai.com/index/frontier-ai-regulation/)
## Abstract
Advanced AI models hold the promise of tremendous benefits for humanity, but society needs to proactively manage the accompanying risks\. In this paper, we focus on what we term “frontier AI” models: highly capable foundation models that could possess dangerous capabilities sufficient to pose severe risks to public safety\. Frontier AI models pose a distinct regulatory challenge: dangerous capabilities can arise unexpectedly; it is difficult to robustly prevent a deployed model from being misused; and, it is difficult to stop a model’s capabilities from proliferating broadly\. To address these challenges, at least three building blocks for the regulation of frontier models are needed: \(1\) standard\-setting processes to identify appropriate requirements for frontier AI developers, \(2\) registration and reporting requirements to provide regulators with visibility into frontier AI development processes, and \(3\) mechanisms to ensure compliance with safety standards for the development and deployment of frontier AI models\. Industry self\-regulation is an important first step\. However, wider societal discussions and government intervention will be needed to create standards and to ensure compliance with them\. We consider several options to this end, including granting enforcement powers to supervisory authorities and licensure regimes for frontier AI models\. Finally, we propose an initial set of safety standards\. These include conducting pre\-deployment risk assessments; external scrutiny of model behavior; using risk assessments to inform deployment decisions; and monitoring and responding to new information about model capabilities and uses post\-deployment\. We hope this discussion contributes to the broader conversation on how to balance public safety risks and innovation benefits from advances at the frontier of AI development\.
OpenAI outlines safety cases for frontier AI training, proposing technical safeguards including alignment, containment, and monitoring to ensure safe development.
OpenAI publishes details on its approach to frontier AI risks and announces progress on voluntary safety commitments made in July 2023, including the release of DALL-E 3 system card and the development of a new Preparedness Framework to manage catastrophic risks from advanced AI systems.
OpenAI, Google, Microsoft, and Anthropic launch the Frontier Model Forum to coordinate on AI safety standards, research, and information sharing among industry, government, and civil society. The initiative focuses on identifying best practices, advancing AI safety research, and establishing secure mechanisms for sharing safety-related information.
DeepMind published the third iteration of its Frontier Safety Framework, expanding risk domains to include harmful manipulation and misalignment risks, with refined risk assessment processes and enhanced governance protocols for advanced AI models.
Major AI companies like Google, OpenAI, and Anthropic are reportedly forming their own safety authority to test frontier AI models before release, potentially without government oversight.