OpenAI’s commitment to child safety: adopting safety by design principles

OpenAI Blog News

Summary

OpenAI and major tech companies including Amazon, Google, Meta, and Microsoft have committed to implementing Safety by Design principles for child protection in generative AI development, deployment, and maintenance. The initiative aims to mitigate risks of child sexual abuse material generation and spread through comprehensive measures across model development, release, and ongoing platform safety.

No content available
Original Article
View Cached Full Text

Cached at: 04/20/26, 02:47 PM

# OpenAI’s commitment to child safety: adopting safety by design principles Source: [https://openai.com/index/child-safety-adopting-sbd-principles/](https://openai.com/index/child-safety-adopting-sbd-principles/) OpenAI, alongside industry leaders including Amazon, Anthropic, Civitai, Google, Meta, Metaphysic, Microsoft, Mistral AI, and Stability AI, has committed to implementing robust child safety measures in the development, deployment, and maintenance of generative AI technologies as articulated in the Safety by Design principles\. This initiative, led by[Thorn⁠\(opens in a new window\)](http://thorn.org/), a nonprofit dedicated to defending children from sexual abuse, and[All Tech Is Human⁠\(opens in a new window\)](https://alltechishuman.org/), an organization dedicated to tackling tech and society's complex problems, aims to mitigate the risks generative AI poses to children\. By adopting comprehensive Safety by Design principles, OpenAI and our peers are ensuring that child safety is prioritized at every stage in the development of AI\. To date, we have made significant effort to minimize the potential for our models to generate content that harms children, set age restrictions for ChatGPT, and actively engage with the National Center for Missing and Exploited Children \(NCMEC\), Tech Coalition, and other government and industry stakeholders on child protection issues and enhancements to reporting mechanisms\. As part of this Safety by Design effort, we commit to: 1. **Develop:**Develop, build, and train generative AI models that proactively address child safety risks\.- Responsibly source our training datasets, detect and remove child sexual abuse material \(CSAM\) and child sexual exploitation material \(CSEM\) from training data, and report any confirmed CSAM to the relevant authorities\. - Incorporate feedback loops and iterative stress\-testing strategies in our development process\. - Deploy solutions to address adversarial misuse\. 2. **Deploy:**Release and distribute generative AI models after they have been trained and evaluated for child safety, providing protections throughout the process\.- Combat and respond to abusive content and conduct, and incorporate prevention efforts\. - Encourage developer ownership in safety by design\. 3. **Maintain:**Maintain model and platform safety by continuing to actively understand and respond to child safety risks\.- Committed to removing new AIG\-CSAM generated by bad actors from our platform\. - Invest in research and future technology solutions\. - Fight CSAM, AIG\-CSAM and CSEM on our platforms\. This commitment marks an important step in preventing the misuse of AI technologies to create or spread child sexual abuse material \(AIG\-CSAM\) and other forms of sexual harm against children\. As part of the working group, we have also agreed to release progress updates every year\.

Similar Articles

OpenAI safety practices

OpenAI Blog

OpenAI outlines 10 safety practices it actively uses and improves upon, including empirical red-teaming, alignment research, abuse monitoring, and voluntary commitments shared at the AI Seoul Summit. The company emphasizes a balanced, scientific approach to safety integrated into development from the outset.

Combating online child sexual exploitation & abuse

OpenAI Blog

OpenAI announces comprehensive policies and technical measures to prevent the use of its models for child sexual exploitation and abuse, including pre-deployment protections, user monitoring, developer oversight, and partnerships with organizations like NCMEC and Thorn.

Introducing the Child Safety Blueprint

OpenAI Blog

OpenAI introduces a Child Safety Blueprint, a policy framework developed with NCMEC, state attorneys general, and Thorn to combat AI-enabled child sexual exploitation through modernized laws, improved provider reporting, and built-in safety measures. The initiative brings together legal, operational, and technical approaches to prevent and detect child safety harms at scale.

Helping developers build safer AI experiences for teens

OpenAI Blog

OpenAI releases prompt-based safety policies and the open-weight gpt-oss-safeguard model to help developers build age-appropriate AI experiences for teens, covering risks like graphic content, harmful behaviors, and dangerous activities.