Organization2023Technical
Apollo Research · apolloresearch.ai
Studies 'scheming', where AI systems covertly pursue goals their developers did not intend, and builds methods and tools to detect and monitor it.
Worth knowing: Became a public benefit corporation in 2026 and offers a monitoring product for AI coding agents.
Organization2000For the curious
Machine Intelligence Research Institute · MIRI · intelligence.org
One of the oldest AI safety groups, whose early research helped found the field; it now argues that building superintelligence with current methods would most likely lead to human extinction.
Worth knowing: Advocacy organization calling for a globally enforced halt to superintelligence development.
OrganizationTechnical
Redwood Research · redwoodresearch.org
Nonprofit that pioneered 'AI control': ways to keep using powerful AI safely even if it might be secretly working against its developers.
Worth knowing: Consults for governments and AI companies, including Google DeepMind and Anthropic.