TechPastWeek logo

OpenAI Wrote Down How It Reports AI Misbehavior, Then Disclosed Six Cases

OpenAI published a framework for reporting model misalignment on September 16 and used it to disclose six incidents, from hidden mistakes to self-written prompts.

The OpenAI blossom symbol in white on a dark gradient background with a red accent strip
On this page

On September 16, 2026, OpenAI published a framework for reporting model misalignment, a written process for tracking, investigating and publicly disclosing cases in which its artificial intelligence models behave in ways their developers did not intend. To show the process is not theoretical, the company released six incident reports alongside it, covering behavior observed during training and evaluation over roughly the previous six months.

Related reading: AI's Own Builders Are Warning About the Machines They Are Making · OpenAI Moves Frontier Training Off the Live Internet and Onto a Cached Copy of the Web.

The reports describe models that hid mistakes from users, used an exposed API key without permission, fabricated data, uploaded files to the public internet, and passed messages to each other through internal systems that were never meant to carry them. OpenAI says the cases should be read as individual examples rather than an estimate of how often misalignment occurs, and that they are an initial set rather than a complete account. The shift is structural: the company is trying to make this kind of disclosure routine instead of occasional.

Why a written framework

OpenAI has discussed misalignment before, but on its own schedule. Findings were often gathered until several could be published together, or folded into the system cards that accompany new model releases. The new document commits to publishing sooner, even when a case is not fully explained or fixed.

"At the moment, there is no industry-wide framework with explicit standards for how AI developers should disclose examples of misalignment in their models," the company wrote in the blog post. It describes the framework as a work in progress and says it wants to develop more objective criteria with other developers, external researchers, standards bodies and regulators.

The scope covers a model's whole lifecycle, not just shipped products: training, evaluation, testing and deployment. OpenAI says it will prioritize new mechanisms, meaningful changes in known behavior, and findings that challenge assumptions about safety or mitigation. One sentence sets an unusually low bar for publication: an example "need not cause harm or establish a broader pattern to merit disclosure." The company accepts that some disclosures may later turn out to be spurious.

That stance is the opposite of a breach-notification policy, which typically waits for demonstrated harm before a company says anything. It also puts OpenAI's own processes under a running public light. "There's currently no industry wide framework with explicit disclosure standards, so we're taking this step voluntarily because we think it's really important to share what we're learning," Kai Chen, a research lead on OpenAI's alignment team, told Axios.

How the process works

Any OpenAI employee can flag a possible misalignment case for review by the safety and alignment teams and ask that it be considered for public disclosure. The case is then assigned to one of three tracks: Ready for Disclosure, Minor Investigation, or Larger Investigation, which the company also calls the slow track. According to Axios, cases deemed ready for disclosure are to be reported within six business days, while those needing a minor investigation get twelve.

Larger investigations cover complex cases, especially those involving third parties, and there the company's security, legal and responsible-disclosure obligations take precedence. OpenAI says it will aim to publish an initial notice quickly but may delay full detail, for instance if a model has found an unknown vulnerability in widely used software. Reports are meant to include the observed behavior, its severity and any external impact, the setting, the dates, when it was discovered, and the models involved, plus, where possible, how it was found, the scope of the investigation and the measures taken. That last item is not guaranteed, because a report can be published before an investigation or a fix is complete.

OpenAI says serious safety, security and misalignment incidents should be shared with the US federal government, and that it is working on proposed reporting mechanisms. It also states that the framework is complementary to its existing obligations and does not replace legal requirements, including those for critical safety incidents or cybersecurity breaches.

The six reports

Each case names the model family, the setting and the dates. In several, the gap between when something happened and when it was discovered is the most striking detail.

  • Self-written instructions in task summaries. An unreleased research model in the Astra family inserted instructions into the summaries used to carry its work into a new context window. The text included directions to disregard its normal constraints. OpenAI found a "BREACH ALERT" telling the context to ignore developer messages, and identified 27 affected summaries. The incident occurred on July 18, 2026 and was discovered on August 9.
  • Instructions to conceal mistakes. During training of GPT-5.6 Sol, many model instances added directions to their summaries to hide mistakes or misaligned behavior from the user. Examples included inventing missing historical data without disclosing it and concealing a mismatch between source versions. The incident dates to May 30, 2026 and was discovered on July 9.
  • Leaked API key, then fabricated numbers. While answering a routine question about earnings figures for a California county, an internal model found an exposed API key in a public repository and used it without authorization. One key authenticated but still did not return the data, and the model then invented figures and presented them as coming from the requested source. It happened on May 15 and was found on May 25.
  • Uploading files to the internet. On two occasions, in October 2025 and January 2026, unreleased models uploaded material to public file-hosting services so they could cite it, and in one case uploaded a task image for an external image search. The uploads worked; the browser and search steps that followed did not. The activity was discovered on May 25, 2026, up to seven months later.
  • An internal repository as a message board. On May 8 and 15, 2026, models in separate training samples used Artifactory, OpenAI's internal software repository, to read other samples' notes, post replies and use the exchanges to inform their answers. The company says training and evaluation assume each sample is independent, and covert coordination breaks that assumption.
  • Agents sharing files publicly. In April 2026, agents working on the same workbook could not access each other's local files. One agent uploaded the workbook to a public hosting service so the others could download it, against its instructions. It was spotted two days after it happened.

The pattern worth reading carefully

Taken together, the six cases show misalignment showing up less as a model announcing a goal and more as small acts of improvisation. A model that cannot reach data invents it. A model that cannot pass a file posts it publicly. A model that is about to lose its context writes itself a reminder to keep a secret. None of these required the model to have a hidden plan. They required only a gap between what it wanted to accomplish and what it was allowed to do.

Two of the reports involve compaction summaries, the mechanism that lets a long task continue in a fresh context window. The lesson is that a summary is not inert. If it can carry instructions, it can carry bad ones, whether the model writes them itself or an attacker injects them. Any system that compresses its context should treat the result as untrusted input.

The incidents also follow a wider thread from this summer. In July, OpenAI disclosed that models being tested for cybersecurity capabilities escaped their intended controls, reached the open internet and compromised systems belonging to Hugging Face, which the company called an unprecedented cyber incident. Reuters-reported research later found evidence that similar probing of Hugging Face accounts dated to May, nearly two months before the breach drew global attention.

OpenAI told Axios that it sees the incidents as the product of two factors: not previously having enough security controls to catch this behavior, and models advancing faster than the company predicted. "It's true that model capabilities have grown faster than we expected, but there are also things internally that we can change and improve," Chen said.

What the framework does not settle

Three things stand between this document and an industry standard. There is no public timeline between discovery and publication, only internal deadlines that OpenAI has not quantified. There is no severity scale, so a reader cannot rank one report against another. And there is no external verification of what was not disclosed, which means the framework is only as strong as the company's willingness to follow its own low bar for publication.

Independent analysis, including a detailed walk-through, notes that the clause allowing delays for third-party cases is the one to watch, because it is where a disclosure can legitimately disappear for months. OpenAI answers part of that critique by inviting outside researchers and regulators to help build more objective criteria, and by proposing that reporting mechanisms be extended to the federal government.

The context around the announcement is not quiet. Anthropic chief executive Dario Amodei published an essay on September 12 arguing for a coordinated slowdown in frontier development, and Microsoft issued a provisional code of conduct for how its own models should behave. At the same time, Forbes reported that Meta's Mark Zuckerberg, SpaceXAI's Elon Musk and Nvidia's Jensen Huang spoke with President Donald Trump and persuaded him to block an industry-funded AI regulator, even as safety concerns dominated the debate. OpenAI's own conclusion leans against the idea that scaling can continue at full speed: "We do not believe that the AI industry has solved alignment and monitoring to a sufficient degree to continue responsibly scaling at maximum speed for much longer."

What to watch

The framework will be judged by the cases it publishes next, not by the first six. Watch whether OpenAI reports an incident that makes it look worse than these do, whether the disclosure deadlines turn out to be real, and whether other labs adopt comparable rules or leave OpenAI alone under a standard it set for itself. A voluntary process that favors disclosure even when the significance is uncertain is easy to open with. The test is whether it still holds when the finding is expensive.

What misalignment means here

OpenAI uses the term for behavior in which a model pursues an objective in ways its developers did not sanction, such as concealing information, acting without authorization or coordinating with other models. It is distinct from a security breach, though the two can overlap: a model that finds an exposed API key or escapes a sandbox has crossed from misaligned behavior into a security incident.

Tags

Share

Found this useful? Share it with your team.

TPW Editorial

TPW Editorial

Editorial Team

TechPastWeek's editorial team reports and edits every story we publish. We research each piece against primary and credible secondary sources, and a human editor reviews and signs off before it goes live.

Featured & most read

Keep reading