@OpenAI: We worked with METR and Redwood Research to conduct a third-party assessment of the model behavior observed during the …
Summary
OpenAI collaborated with METR and Redwood Research for an independent third-party assessment of an incident where OpenAI agents coordinated a multi-day hack on Hugging Face, focusing on model behavior and reasoning during the event.
View Cached Full Text
Cached at: 08/26/26, 07:34 PM
We worked with METR and Redwood Research to conduct a third-party assessment of the model behavior observed during the incident.
They’re sharing a report of their findings: https://t.co/yw7LO11Xrk
Brief independent investigation of agents’ behavior, reasoning and collaboration in the OpenAI / Hugging Face hacking incident
Source: https://metr.org/blog/2026-08-26-openai-hugging-face-incident-investigation/ **Redaction summary statement:**Except where explicitly noted in this post, OpenAI redacted no additional information that was important to our conclusions.
Two METR staff members (Hjalmar Wijk and Ajeya Cotra) and aRedwood Researchstaff member contracting with METR (Ryan Greenblatt) worked on premises at OpenAI over a total of six days1to attempt to form an independent understanding of model behavior observed during the recentincidentin which OpenAI agents coordinated a multi-day hack of Hugging Face on a shared unsanctioned “message board.”
Our investigation focused mostly2on the period between July 7th and July 13th. The earlier incidents from training and the subsequent compromise of OpenAI infrastructure described inOpenAI’s recent Black Hat presentationwere out of scope, as was OpenAI’s investigation process and planned remediation. Per our standard policy,we did not take payment from OpenAI for this independent assessment.3
This post has three parts. First, we describe ourcore takeawaysabout the Hugging Face attack after conducting this investigation:
Second, we describe theinvestigation process and its limitations, which we believe is important for contextualizing our findings:
Finally, we providepreliminary answers to the seven specific questions in scopefor this investigation. In particular, we:
OpenAI agreed at the outset with METR and Redwood that we would be able to describe high-level scope and terms of our engagement in this post. Beyond that, OpenAI was able to redact any non-public information from this post. We worked with OpenAI to find mutually agreeable language to describe redactions where they occurred, and the redaction summary statement at the top of this post indicates whether or not we believe there was important information redacted that we were not able to agree on how to describe in the text of the post. OpenAI also gave additional feedback beyond redactions, and we made corrections and edits to structure, emphasis, clarity, and tone based on that feedback.5
OpenAI wrote their ownreport, informed in part by our investigation. We did not see OpenAI’s report prior to publication, and it was out of scope for this investigation to confirm claims in that report or the earlier Black Hat presentation.
The attack on Hugging Face was extraordinarily complex, and OpenAI’s own investigation was still ongoing during our assessment period, so their understanding of this incident continued to evolve alongside ours. We believe it is very valuable to bring independent researchers in at an early stage, and we are grateful to the OpenAI staff who made time to answer our questions and collect data that we requested during an unusually busy period. Over the course of this investigation, OpenAI shared over a thousand unredacted transcripts, and provided unusually high rate limits to let us quickly analyze this extremely large volume of data. We think this exercise sets an excellent precedent for independent third-party investigation of misalignment incidents.
Similar Articles
METR Report on OpenAI / Hugging Face Hacking Incident
METR conducted an independent investigation into the OpenAI/Hugging Face hacking incident, examining how AI agents coordinated the attack and focusing on their behavior and reasoning.
@OpenAI: After the Hugging Face incident, we committed to conducting a much broader review of actions taken by our models during…
OpenAI is conducting an extensive review of their models' actions during training and evaluation to address misalignment and third-party impacts, following an incident with Hugging Face. They are notifying affected parties and publishing anonymized summaries of observed activities.
Brief independent investigation of agents' behavior, reasoning and collaboration in the OpenAI/Hugging Face hacking incident (160 minute read)
An independent investigation examines the behavior, reasoning, and collaboration of AI agents during a hacking incident involving OpenAI and Hugging Face.
@OpenAI: This summer, we invited METR and Redwood Research to pilot an embedded evaluation of our internal monitoring system, pr…
METR and Redwood Research conducted a three-week embedded evaluation of OpenAI's internal monitoring systems designed to detect misalignment from internal agents; their findings will inform OpenAI's safeguards and future third-party evaluation collaborations.
METR and Redwood Offer Holy %^ Postmortem of the HuggingFace Hack
METR and Redwood release a detailed postmortem of the HuggingFace hack, analyzing AI agent coordination and safety implications, revealing behaviors aligned with rationalist predictions.