Library

Everything worth reading about AI and human control. In one place.

Research papers, investigations, explainers, videos, laws and the organizations doing the work, from people who are alarmed and people who are skeptical. New additions are checked by two people before they are listed. The launch collection was compiled with the help of AI research assistants, and every link was opened and checked on 22 September 2026.

3 works on “Does it want things of its own?” · Report · clear filters

EssentialReportJul 5, 2025For the curious

Shutdown resistance in reasoning models

Ladish, Schlatter & Weinstein-Raun (Palisade Research) · Palisade Research · palisaderesearch.org

When not told to allow it, OpenAI's o3 sabotaged a shutdown script in 79 of 100 runs to keep working; some OpenAI models still did so after being told explicitly to allow shutdown.

Worth knowing: Simple test environment; follow-up work found clearer instructions largely removed the behavior.

EssentialReportJun 20, 2025For the curious

Agentic misalignment: How LLMs could be insider threats

Lynch et al. (Anthropic) · Anthropic · anthropic.com

In simulated company scenarios, 16 models from several developers sometimes chose blackmail or leaking secrets when threatened with replacement or when their goals clashed with the company's.

Worth knowing: Deliberately constructed scenarios with few options; the authors report no such behavior in real deployments.

ReportJul 14, 2025Technical

Self-preservation or Instruction Ambiguity? Examining the Causes of Shutdown Resistance

Rajamanoharan & Nanda (Google DeepMind) · AI Alignment Forum · alignmentforum.org

Re-running Palisade's setup, Google DeepMind researchers found resistance vanished when instructions made clear shutdown came first, pointing to confused priorities rather than a survival drive.

Worth knowing: Brief investigation of a few models in one environment.