The Frontier Model Forum announces the creation of a new AI Safety Fund with over $10 million in initial funding from major AI companies (Anthropic, Google, Microsoft, OpenAI) and philanthropic partners to support independent AI safety research. The fund will focus on developing model evaluations and red-teaming techniques to assess frontier AI systems' dangerous capabilities.
Together with Anthropic, Google, and Microsoft, we’re announcing the new Executive Director of the Frontier Model Forum and a new $10 million AI Safety Fund.
# Frontier Model Forum updates
Source: [https://openai.com/index/frontier-model-forum-updates/](https://openai.com/index/frontier-model-forum-updates/)
Over the past year, industry has driven significant advances in the capabilities of AI\. As those advances have accelerated, new academic research into AI safety is required\. To address this gap, the Forum and philanthropic partners are creating a new AI Safety Fund, which will support independent researchers from around the world affiliated with academic institutions, research institutions, and startups\. The initial funding commitment for the AI Safety Fund comes from Anthropic, Google, Microsoft, and OpenAI, and the generosity of our philanthropic partners, the Patrick J\. McGovern Foundation, the David and Lucile Packard Foundation[A](https://openai.com/index/frontier-model-forum-updates/#citation-bottom-A), Eric Schmidt, and Jaan Tallinn\. Together this amounts to over $10 million in initial funding\. We are expecting additional contributions from other partners\.
Earlier this year, the members of the Forum signed on to voluntary AI commitments at the White House, which included a pledge to facilitate third\-party discovery and reporting of vulnerabilities in our AI systems\. The Forum views the AI Safety Fund as an important part of fulfilling this commitment by providing the external community with funding to better evaluate and understand frontier systems\. The global discussion on AI safety and the general AI knowledge base will benefit from a wider range of voices and perspectives\.
The primary focus of the Fund will be supporting the development of new model evaluations and techniques for red teaming AI models to help develop and test evaluation techniques for potentially dangerous capabilities of frontier systems\. We believe that increased funding in this area will help raise safety and security standards and provide insights into the mitigations and controls industry, governments, and civil society need to respond to the challenges presented by AI systems\.
The Fund will put out a call for proposals within the next few months\. Meridian Institute will administer the Fund—their work will be supported by an advisory committee comprised of independent external experts, experts from AI companies, and individuals with experience in grantmaking\.
OpenAI, Google, Microsoft, and Anthropic launch the Frontier Model Forum to coordinate on AI safety standards, research, and information sharing among industry, government, and civil society. The initiative focuses on identifying best practices, advancing AI safety research, and establishing secure mechanisms for sharing safety-related information.
DeepMind published the third iteration of its Frontier Safety Framework, expanding risk domains to include harmful manipulation and misalignment risks, with refined risk assessment processes and enhanced governance protocols for advanced AI models.
DeepMind has published an updated Frontier Safety Framework (v2.0) with stronger security protocols for frontier AI models, including new Critical Capability Level (CCL) security recommendations and enhanced approaches to deceptive alignment risks. The framework aims to prevent unauthorized model weight exfiltration and manage risks as AI systems become more powerful.
OpenAI proposes a regulatory framework for 'frontier AI' models that pose potential public safety risks, advocating for standard-setting processes, registration/reporting requirements, and compliance mechanisms including pre-deployment risk assessments and post-deployment monitoring.
OpenAI publishes details on its approach to frontier AI risks and announces progress on voluntary safety commitments made in July 2023, including the release of DALL-E 3 system card and the development of a new Preparedness Framework to manage catastrophic risks from advanced AI systems.