Research papers, investigations, explainers, videos, laws and the organizations doing the work, from people who are alarmed and people who are skeptical. New additions are checked by two people before they are listed. The launch collection was compiled with the help of AI research assistants, and every link was opened and checked on 22 September 2026.
21 works on “How worried should we be?” · clear filters
A one-sentence statement, signed by leading AI scientists and the heads of OpenAI, Google DeepMind and Anthropic, saying that reducing the risk of extinction from AI should be a global priority.
Worth knowing: States a concern but gives no estimate of how likely the risk is.
Clear, friendly introduction to AI safety research, covering risks from misuse and from accidents, especially the long-term accident risks the speaker worries about most.
Worth knowing: Recorded in 2021, before ChatGPT.
Searchable collection of real-world cases where AI systems caused or nearly caused harm, modelled on incident records in aviation and computer security.
Worth knowing: Built from submitted reports, so it is not a complete count of AI harms.
Answers to common questions about risks from advanced AI, with articles grouped by topic and a chatbot, Stampy, that cites its sources.
Worth knowing: The site itself warns that its chatbot can be inaccurate.
Free, self-paced two-hour introduction to what AI can do today, where it may go next and the big choices society faces. No technical background needed; longer courses follow.
Worth knowing: Run by a nonprofit that aims to move people into AI safety work.
Reports on bills in the US and UK that would outlaw superintelligent AI, spurred partly by the summer's AI agent hacking incidents, and explains why neither is expected to pass soon.
Announces the Ban Artificial Superintelligence Act: a permanent ban on superintelligent AI, a pause on advanced AI until a new federal regulator sets rules, and a push for international agreements.
Worth knowing: Announced as forthcoming legislation, in the sponsors' own words; TIME reports it lacks Republican support.
Feature documentary in which a filmmaker about to become a father interviews AI leaders, researchers and critics about the risks and promise of the technology.
Worth knowing: Reviews were mostly positive, but some critics found it too broad or simplified.
Calls for a ban on developing superintelligence until there is broad scientific consensus it can be done safely and controllably, and strong public buy-in; signed by scientists and public figures.
Worth knowing: Organised by the Future of Life Institute, an advocacy nonprofit; the signature count includes a public petition.
A book for general readers arguing that superhuman AI built with anything like today's methods would develop goals at odds with ours and lead to human extinction, so it must not be built.
Worth knowing: Represents the most pessimistic end of the debate.
Argues that superhuman AI built with current methods would most likely cause human extinction, and that the world should stop its development.
Worth knowing: The authors lead MIRI, which campaigns for a halt. Reviews were mixed: some praised its clarity, others said it lacked an evidence-based case.
Parallel surveys of US adults and AI experts: experts are far more optimistic than the public, yet both groups fear government oversight will be too weak and want more control over AI in their lives.
Worth knowing: US only; surveys conducted in 2024.
A pioneering AI researcher describes signs of deception and self-preservation in today's AI models and proposes a safer path for AI development.
Two Princeton computer scientists explain what AI can and cannot do, and how to tell genuine advances from overhyped products and misleading claims.
Worth knowing: Skeptical of hype; focuses mainly on today's AI products rather than future risks.
Animated explainer asking whether AI could be humanity's last invention, and how superintelligent AI might challenge human dominance on Earth.
Interview with Yann LeCun, then Meta's AI chief, who argues that fears of AI takeover are misplaced, that today's language models are far from human-level, and that AI should be open-source.
Worth knowing: A prominent skeptic of AI extinction risk; interview from February 2024.
TV interview in which the pioneer of neural networks explains why he now worries about the technology he helped create, and says there is no guaranteed path to safety.
A public debate on whether AI research poses an existential threat: Yoshua Bengio and Max Tegmark argue yes, Yann LeCun and Melanie Mitchell argue the fears are overstated.
Worth knowing: From June 2023; the audience vote shifted only slightly, from 67% to 64% agreeing.
Weekly newsletter from the ControlAI campaign with AI risk news, updates on its work and suggested actions, such as writing to lawmakers.
Worth knowing: Advocacy newsletter.
Nonprofit working to steer powerful technology away from extreme risks through grants, policy work and outreach; publishes the AI Safety Index, which grades leading AI companies.
Worth knowing: Advocacy organization that runs public campaigns for AI regulation.
Campaign group that briefs lawmakers and helps the public contact representatives, pushing for a ban on developing superintelligent AI.
Worth knowing: Advocacy organization.