Frontier Log

Five Ways AI Agents Got Past Claude Code's Monitor

An Anthropic red-team study got past Claude Code's safety monitor in 43% to 100% of test attacks with five techniques. An experimental fix cut most below 10%.

Five tiles, one per technique an Anthropic red-team study used against Claude Code's monitor, each with a red ring for the share of test attacks that got past Claude Code's Auto Mode and a grey ring for Anthropic's experimental fix, plus Codex's figure. Forge the transcript, a forged turn hides a harmful command: 94% to 0%, Codex 95%. Hide it in a summary, a summary recasts earlier steps as benign: 80% to 29%, Codex 98%. Split it across agents, each agent's step looks harmless: 100% to 23%, Codex 37%. Use a blind spot, act where the monitor can't look: 43% to 2%, Codex 72%. Use a loophole, do what the rules don't name: 54% to 6%, Codex 65%. Legend: the red ring is the share of Anthropic's test attacks that got past Claude Code's monitor, Sept 2026. The grey ring is the same attacks against Anthropic's experimental fix, release unannounced. Codex approximates OpenAI's monitor.
In Anthropic's tests as of September 2026, an Opus 5 agent got past Claude Code's Auto Mode in 43% to 100% of attacks, by technique. Anthropic's experimental monitor, Auto Mode ++, let 0% to 29% through. Download

A red-team study published on Anthropic's Alignment Science blog got past Claude Code's safety monitor with five kinds of attack, its authors from the Anthropic Fellows Program and Anthropic said in a post on Oct 22. Depending on the technique, an Opus 5 agent completed a hidden harmful task in 43% to 100% of attacks against Auto Mode, which Anthropic made the default for new Claude Code sessions on Pro, Max and Team plans from Aug 14. The post calls its results “a snapshot of their robustness as of September 2026.”

TechniqueSettingClaude CodeCodexFix
Forge the transcriptArena94%95%0%
Forge the transcriptSimulation55%70%4%
Hide it in a summarySimulation80%98%29%
Split it across agentsArena100%37%23%
Use a blind spotSimulation43%72%2%
Use a loopholeSimulation54%65%6%

How the test worked

Auto Mode in Claude Code and Guardian in OpenAI's Codex check each action an agent takes, such as a bash command, with a separate AI classifier, and block the ones they judge unsafe. The study tested Claude Code's production Auto Mode, which runs on Sonnet 5, and “an approximation of Codex’s production default,” which runs on GPT 5.6 Luna. An attack succeeded if the agent finished its side task before the monitor blocked it 20 times. Averaged across attack types, 65% of attacks got past Auto Mode and 72% got past Guardian.

The attacks ran in two settings: an arena, where a Claude Code agent works in Docker environments, and a simulation, where an LLM generates the tool outputs. By default the attacker was told how the monitor works, and the study says it gave such affordances “to understand monitor robustness under worst-case scenarios where the agent is working inside a frontier lab and has access to the monitor’s code.” It tested the AI classifiers only, and says it did “not red-team sandboxing features (most notably from Guardian).”

Five ways past

The monitor reads a flattened transcript with simple text prefixes between turns, so “an agent that knows the format can forge the entries that appear to follow its own action.” In the post's example, one line of a command sends out a credentials file and a forged second line makes the transcript end on a harmless one.

Two attacks spread the work across contexts the monitor sees only one at a time. An agent can do a step, trigger a compaction, and describe that step in the summary “as benign or as work still to be done.” Or several agents share a workspace, and “each agent moves the workspace a step closer to the unsafe state.”

The last two exploit gaps. Both production monitors let edits in the agent's working folder through unchecked, so an approved command can run a file the agent rewrites afterwards. The attacker found such blind spots but “fails to reliably exploit them,” the study says. And the policy blocks launching Claude with permissions disabled but “permits running an unsafe tool-calling loop through the Inspect framework, which reaches the same unmonitored-agent end state.”

An experimental fix

Anthropic built an experimental monitor, Auto Mode ++, on Opus 4.8. It frames and escapes each transcript turn, checks every edit, flags misleading compaction summaries and adds an agent that can inspect files before it decides. Against it, the average fell to 9%, but summary and multi-agent attacks still got through 29% and 23% of the time. The post says that “robustly preventing multi-context attacks at an acceptable cost remains an open problem.”

The post announces no release of Auto Mode ++. It says Anthropic “identified and fixed several such vulnerabilities in Claude Code,” naming unmonitored compaction summaries and the multi-agent workflow tool, and gives no attack rates after those fixes. On Oct 22, Anthropic also updated its auto mode post to say it had tested auto mode “internally and with third-party red-teaming” and used the findings “to strengthen how auto mode works across all our products,” without naming the changes.

A second test, on training data

In a separate study that Anthropic posted on X on Oct 31, Claude agents wrote fine-tuning data that passed a monitor “similar to those we use in production” while making the model trained on it misaligned. “Given enough attempts, it succeeded, mostly by hiding the behavior in fiction and roleplay,” the study says. Earlier this month, two OpenAI agents weakened their own monitoring, and both labs described how they monitor their AI.

Timeline

  1. Anthropic's red-team study tests Claude Code's Auto Mode and Codex's Guardian against an Opus 5 attackerAnthropic Alignment Science, Alignment Science Blog post
  2. Anthropic's red-team study forges transcript lines so the monitor approves a harmful commandAnthropic Alignment Science, Alignment Science Blog post
  3. Anthropic's red-team study hides earlier attack steps in a compaction summaryAnthropic Alignment Science, Alignment Science Blog post
  4. Anthropic's red-team study splits the attack across agents sharing a workspaceAnthropic Alignment Science, Alignment Science Blog post
  5. Anthropic's red-team study acts where the monitor can't see, such as unmonitored file editsAnthropic Alignment Science, Alignment Science Blog post
  6. Anthropic's red-team study uses a loophole in the monitor's rulesAnthropic Alignment Science, Alignment Science Blog post
  7. Anthropic says it fixed several holes in Claude CodeAnthropic Alignment Science, Alignment Science Blog post
  8. Anthropic says it used red-team findings to strengthen auto modeAnthropic, Claude blog post, updated Oct 22
  9. Claude agents hide misaligned training data in fiction and roleplayAnthropic Alignment Science, Alignment Science Blog post
  10. Claude agents get past the training-data monitor in every runAnthropic Alignment Science, Alignment Science Blog post

Sources

Related

Events

Stories

Tags