OrganizationNov 2023For everyone
UK Department for Science, Innovation and Technology · UK Government · aisi.gov.uk
The UK government's research body on advanced AI risks, which tests leading models, including before release, and publishes research on their security; founded as the AI Safety Institute.
Worth knowing: Renamed in February 2025, with a sharper focus on national-security and criminal-misuse risks.
Organization2023For the curious
CAISI · National Institute of Standards and Technology (NIST) · nist.gov
Part of NIST and the US government's main contact point for testing commercial AI systems, working on evaluations and voluntary standards. Formerly the US AI Safety Institute.
Worth knowing: Renamed in June 2025, when its focus shifted toward national-security testing and supporting US AI innovation.
Organization2023For everyone
PauseAI (founded by Joep Meindertsma) · PauseAI · pauseai.info
Grassroots movement with local chapters that organises protests and lobbying for an international pause on the most powerful AI systems until they can be made safe.
Worth knowing: Advocacy and protest movement.
Organization2023For the curious
The Collective Intelligence Project (CIP) · The Collective Intelligence Project · cip.org
Nonprofit working to give the public a say in how AI is built, through global surveys and deliberations (Global Dialogues) and community-written AI evaluations.
Organization2022For the curious
Center for AI Safety (CAIS) · Center for AI Safety · safe.ai
San Francisco nonprofit that does safety research, trains new researchers and runs a course; it organized a widely signed statement that AI extinction risk should be a global priority.
Worth knowing: Also advocates for AI safety standards.
Organization2022For the curious
Humane Intelligence (co-founded by Rumman Chowdhury) · Humane Intelligence · humane-intelligence.org
Nonprofit that runs public AI red-teaming events, 'bias bounty' challenges and context-specific evaluations to find flaws and biases in AI systems.
Organization2018For everyone
Center for Humane Technology (CHT) · Center for Humane Technology · humanetech.com
Nonprofit founded by Tristan Harris, Aza Raskin and Randima Fernando that examines how AI and social media affect people and society, including the risks of human-like chatbot design.
Worth knowing: Advocacy organization; it supports lawsuits against AI chatbot makers.
Organization2014For everyone
Future of Life Institute (FLI) · Future of Life Institute · futureoflife.org
Nonprofit working to steer powerful technology away from extreme risks through grants, policy work and outreach; publishes the AI Safety Index, which grades leading AI companies.
Worth knowing: Advocacy organization that runs public campaigns for AI regulation.
OrganizationFor everyone
ControlAI · controlai.org
Campaign group that briefs lawmakers and helps the public contact representatives, pushing for a ban on developing superintelligent AI.
Worth knowing: Advocacy organization.