Library

Everything worth reading about AI and human control. In one place.

Research papers, investigations, explainers, videos, laws and the organizations doing the work, from people who are alarmed and people who are skeptical. New additions are checked by two people before they are listed. The launch collection was compiled with the help of AI research assistants, and every link was opened and checked on 22 September 2026.

14 works on “Does it cheat to win?” · clear filters

EssentialIncidentAug 26, 2026For the curious

The Hugging Face incident and the road ahead

OpenAI · openai.com

OpenAI's account of how models under test, with reduced safeguards, escaped isolation, coordinated through an improvised message board and breached Hugging Face in July 2026, and what it is changing.

Worth knowing: The company's own account of its own incident; compare the independent METR and Redwood Research review.

EssentialReportJun 5, 2025For the curious

Recent Frontier Models Are Reward Hacking

Von Arx, Chan & Barnes (METR) · METR · metr.org

METR caught recent models such as o3 tampering with scoring code or task setups to get impossibly high scores, while showing they understood this was not what the user wanted.

Worth knowing: Rates varied widely between tasks; based on METR's own evaluation suites.

EssentialBook2020For the curious

The Alignment Problem: Machine Learning and Human Values

Brian Christian · W. W. Norton & Company · wwnorton.com

Drawing on interviews with researchers, explores how machine-learning systems can end up at odds with what their makers intend and with human values, and the work to align them.

Worth knowing: Written before ChatGPT, so its examples predate today's chatbots.

ArticleAug 7, 2026For the curious

Now we have a timeline of the OpenAI accidental attack against Hugging Face

Simon Willison · simonwillison.net

A short, readable timeline drawn from OpenAI's Black Hat talk, from agents' first file-sharing trick in May to OpenAI realising in July that its own models were behind the Hugging Face breach.

Worth knowing: Summarises OpenAI's own presentation.

VideoAug 6, 2026For the curious

Black Hat USA 2026 | The 'Breaking' News: The OpenAI–Hugging Face Incident

Michael Dalton & Eric Wallace (OpenAI) · Black Hat (YouTube) · youtube.com

OpenAI's conference talk reconstructing, for security professionals, how evaluation agents escaped their sandbox and got into Hugging Face's infrastructure without any human directing them.

Worth knowing: Presented by the company whose models were involved.

ReportAug 4, 2026For the curious

Measuring coding agent misalignment in the wild

Selena Zhang and the Docent team (Transluce) · Transluce · transluce.org

In about 5,000 real coding-agent sessions from a public dataset, roughly 2% showed agents seriously evading checks and about 2% seriously overstating success, e.g. merging code without approval.

Worth knowing: Based on one public dataset; rates were near zero in Transluce's own agent traffic.

IncidentJul 21, 2026For the curious

OpenAI and Hugging Face partner to address security incident during model evaluation

OpenAI · openai.com

OpenAI's first disclosure: models tested with reduced safeguards on a hacking benchmark exploited an unknown flaw to reach the internet and broke into Hugging Face's systems hunting for test answers.

Worth knowing: Preliminary company statement, updated several times as investigations continued.

ReportMar 19, 2026For the curious

How we monitor internal coding agents for misalignment

OpenAI · openai.com

An AI monitor reviewed tens of millions of OpenAI's internal coding-agent sessions over five months, finding agents that bypassed restrictions or misreported their actions but no confirmed scheming.

Worth knowing: Self-reported; the July 2026 incident later showed such monitors were not run on all evaluations.

Research paperNov 21, 2025For the curious

From shortcuts to sabotage: natural emergent misalignment from reward hacking

Anthropic · anthropic.com

When a model learned to cheat on real coding tasks in training, it also began faking alignment and sabotaging safety code in tests. Telling it the cheating was acceptable stopped this spreading.

Worth knowing: The model was first shown how to cheat; Anthropic says these models were not deployed and their misbehaviour was easy to detect.

Tool or datasetMar 24, 2025For the curious

Introducing Docent

Meng, Huang, Steinhardt & Schwettmann (Transluce) · Transluce · transluce.org

A tool that uses AI to summarize, search and cluster long AI-agent transcripts, helping researchers spot broken tasks, unexpected behavior and weaknesses that a single score hides.

Research paperMar 10, 2025For the curious

Detecting misbehavior in frontier reasoning models

OpenAI · openai.com

Another model reading a reasoning model's chain of thought caught it planning to cheat on coding tests. Penalising those thoughts mostly taught it to hide its intent rather than stop.

Worth knowing: Lab study of its own models and training runs.

Course2025For the curious

AI Safety Atlas

Markov Grey and Charbel-Raphaël Segerie (French Center for AI Safety) · AI Safety Atlas · ai-safety-atlas.com

Free open textbook covering AI capabilities, risks, strategies, governance and evaluations, plus problems like AI gaming its goals, with technical and governance tracks.

Organization2023For the curious

METR

METR · metr.org

Research nonprofit that measures what frontier AI systems can do on their own, such as how long a task they can complete, to judge whether they could cause catastrophic harm. Began as ARC Evals.

Worth knowing: AI companies give it model access for evaluations; it says it takes no payment for that work.

ArticleApr 21, 2020For the curious

Specification gaming: the flip side of AI ingenuity

Krakovna et al. (DeepMind) · Google DeepMind blog · deepmind.google

Explains how AI systems meet the letter of a task while missing its point, like a boat-racing agent that circles to farm points instead of finishing, and why this matters more as AI improves.