Employees of frontier AI companies, supported by Guidelight AI Standards and Encode AI · pacingthefrontier.com
Over a thousand staff at OpenAI, Anthropic, Google DeepMind, Meta and other labs ask the US government to back an international effort to build tools for deliberately pacing frontier AI development.
Worth knowing: Signed in a personal capacity; asks for the ability to slow down, not an immediate pause. OpenAI and Anthropic later endorsed it as companies.
Robert Miles · Robert Miles AI Safety (YouTube) · youtube.com
Clear, friendly introduction to AI safety research, covering risks from misuse and from accidents, especially the long-term accident risks the speaker worries about most.
Worth knowing: Recorded in 2021, before ChatGPT.
Founded by Rob Miles; volunteer team · AISafety.info
Answers to common questions about risks from advanced AI, with articles grouped by topic and a chatbot, Stampy, that cites its sources.
Worth knowing: The site itself warns that its chatbot can be inaccurate.
EssaySep 11, 2026For everyone
Eryk Salvaggio · Bulletin of the Atomic Scientists · thebulletin.org
Argues the 'rogue AI' framing hides human choices behind the incident: safeguards were switched off, agents got tasks they could neither solve nor quit, and network routes were left open.
Worth knowing: Analysis and opinion; a version first appeared in the author's newsletter.
Law or policySep 3, 2026For everyone
Sen. Bernie Sanders and Rep. Greg Casar · Office of Senator Bernie Sanders · sanders.senate.gov
Announces the Ban Artificial Superintelligence Act: a permanent ban on superintelligent AI, a pause on advanced AI until a new federal regulator sets rules, and a push for international agreements.
Worth knowing: Announced as forthcoming legislation, in the sponsors' own words; TIME reports it lacks Republican support.
Law or policyJul 23, 2026For everyone
Rep. Ted W. Lieu and Rep. Nathaniel Moran · Office of Congressman Ted Lieu · lieu.house.gov
Announces the bipartisan AI Kill Switch Act, which would make developers of the most powerful AI keep the ability to throttle or shut systems down, and let DHS order a slowdown or shutdown.
Worth knowing: A proposed bill, not law, described here by its sponsors.
BookSep 16, 2025For everyone
Eliezer Yudkowsky and Nate Soares · Little, Brown and Company · ifanyonebuildsit.com
Argues that superhuman AI built with current methods would most likely cause human extinction, and that the world should stop its development.
Worth knowing: The authors lead MIRI, which campaigns for a halt. Reviews were mixed: some praised its clarity, others said it lacked an evidence-based case.
VideoApr 2025For everyone
Yoshua Bengio · TED · ted.com
A pioneering AI researcher describes signs of deception and self-preservation in today's AI models and proposes a safer path for AI development.
Newsletter2023For everyone
ControlAI · Substack · blog.controlai.org
Weekly newsletter from the ControlAI campaign with AI risk news, updates on its work and suggested actions, such as writing to lawmakers.
Worth knowing: Advocacy newsletter.
Organization2023For everyone
PauseAI (founded by Joep Meindertsma) · PauseAI · pauseai.info
Grassroots movement with local chapters that organises protests and lobbying for an international pause on the most powerful AI systems until they can be made safe.
Worth knowing: Advocacy and protest movement.
VideoMar 3, 2017For everyone
Rob Miles · Computerphile (YouTube) · youtube.com
Rob Miles explains why fitting an off switch to a capable AI is harder than it sounds: a system pursuing a goal may have good reasons to stop you from pressing it.
Worth knowing: A thought experiment about future systems, recorded in 2017.
OrganizationFor everyone
ControlAI · controlai.org
Campaign group that briefs lawmakers and helps the public contact representatives, pushing for a ban on developing superintelligent AI.
Worth knowing: Advocacy organization.