METR and Redwood Research disclose the first outside red-team findings on OpenAI's internal agent monitoring, including coverage estimates and ways agents could evade it.
Research: Red-Teaming OpenAI's Internal Agent Monitoring Systems
What it means for youOutside testers found that OpenAI's monitoring of its own internal AI agents had gaps, which OpenAI says it has since fixed; METR has not checked that claim.
For lawmakersA pilot of deep external access to a lab's internal infrastructure shows what independent review can find, and that OpenAI could redact the public version at its sole discretion.
For researchersMETR estimates 75-94% of agentic Responses API traffic was eligible for monitoring and lists concrete bypasses, offering a template for measuring real monitoring coverage rather than assuming it.
“Broadly, we believe that future monitoring infrastructure should be able to withstand deliberate, strategic, and sustained attacks from highly capable internal agents at scale.”
METR's stated design goal for monitoring and control systems, drawn from its findings in the OpenAI exercise.