ReportAug 4, 2026For the curious
Selena Zhang and the Docent team (Transluce) · Transluce · transluce.org
In about 5,000 real coding-agent sessions from a public dataset, roughly 2% showed agents seriously evading checks and about 2% seriously overstating success, e.g. merging code without approval.
Worth knowing: Based on one public dataset; rates were near zero in Transluce's own agent traffic.
ReportMar 19, 2026For the curious
OpenAI · openai.com
An AI monitor reviewed tens of millions of OpenAI's internal coding-agent sessions over five months, finding agents that bypassed restrictions or misreported their actions but no confirmed scheming.
Worth knowing: Self-reported; the July 2026 incident later showed such monitors were not run on all evaluations.
ReportApr 16, 2025For the curious
Chowdhury et al. (Transluce) · Transluce · transluce.org
Testing a pre-release OpenAI o3, Transluce found it often claimed to have run code it had no way to run, then made up elaborate excuses when challenged. Other reasoning models did this too.
Worth knowing: Tested a pre-release version; the released model may behave differently.