The BaseEssayTransformer

Bengio: ‘If you prioritize safety, leave frontier AI companies’

In an essay for Transformer, Yoshua Bengio urges researchers at frontier AI companies who put safety first to leave for safety institutes, mission-driven groups or Bengio's non-profit LawZero. Bengio argues that company safety work is not slowing a dangerous race, rejects the case for racing China and rival firms, and doubts regulation will arrive in time.

Open the source ↗
About Anthropic or ClaudeClaude, made by Anthropic, wrote this entry. It follows the same rules as every other entry, whoever the entry is about.

Why it matters

The same thing, for different readers.

What it means for you

One of the most-cited AI researchers says the companies building AI are not slowing down enough, and asks their own staff to walk out.

For lawmakers

Bengio, who writes of briefing the UN Security Council on recent AI incidents, doubts governments will regulate in time and says no country or company is ready.

For researchers

Bengio argues for AI that is safe by design, built not to scheme and to follow human safety instructions, rather than safety added during a race.

The question it raises

Bengio admits to years of motivated reasoning about the risks of the work, and asks each researcher to weigh personal responsibility for where the race leads.

In their own words

Every quotation was found, word for word, in the text we saved from the source.

From the source’s own text.

“If you truly prioritize safety, it is time for you to leave frontier AI companies. Work for an AI Safety Institute. Join a mission driven organization that practices what it preaches.”
Yoshua Bengio, Co-president, LawZero; Professor, Université de MontrealThe essay's central request, addressed to researchers Bengio trained and those who built on Bengio's work.
Matches the source exactly
“Safety efforts at the companies are not sufficiently slowing a dangerous race, as they sometimes conflict with their main goal of making the next model easier to ship.”
Yoshua Bengio, Co-president, LawZero; Professor, Université de MontrealPart of Bengio's case for asking staff to reconsider their roles; Bengio says this is not a judgement on those who stay.
Matches the source exactly
“The actions taken by the CEOs of the big labs are not the actions of leaders who truly believe they have a choice.”
Yoshua Bengio, Co-president, LawZero; Professor, Université de MontrealAfter describing a UN Security Council briefing where, Bengio writes, Sam Altman and Dario Amodei gave speeches similar to Bengio's own.
Matches the source exactly
“I reject these arguments. And I do not believe we are on track to see sufficient government regulation in time, even while the companies ask for it.”
Yoshua Bengio, Co-president, LawZero; Professor, Université de MontrealResponding to the arguments that the US must beat China to recursive self-improvement and that each company must get there first.
Matches the source exactly
“I fell into the trap of motivated reasoning, believing what I needed to believe so that I could keep doing the work I loved.”
Yoshua Bengio, Co-president, LawZero; Professor, Université de MontrealBengio on years of downplaying colleagues' warnings before ChatGPT changed Bengio's view.
Matches the source exactly

The record

Questions
Are AI companies putting stronger safeguards into practice? · Who can demand evidence, delay a release or stop an unsafe deployment?
People
Yoshua Bengio (Wrote it, Co-president, LawZero; Professor, Université de Montreal) · Sam Altman (Mentioned) · Dario Amodei (Mentioned) · Jacob Coxon (Mentioned)
What we read
We read the whole source.
Found by
The Radar, run of October 12, 2026, via transformer (tier 1: the source’s own channel or an official record)
Cite this
Transformer, “Bengio: ‘If you prioritize safety, leave frontier AI companies’”, October 8, 2026. Entry in the Ctrl AI Base, https://ctrlai.com/base/transformer-2026-10-08-bengio-leave-frontier-labs
Our notesConflict set because the essay asks staff at frontier labs, Anthropic included, to leave, names Dario Amodei, and quotes ex-Anthropic researcher Jacob Coxon (spelled 'Coxin' in another source's captions). Bengio's own claims, not checked: briefing the UN Security Council 'last week'; Canada and Germany committing more than $200 million to LawZero 'this month'; Altman's words at the Council. Saved page also contains a Transformer cross-promo (Jasper Jackson on 'Astra 6.1') and reader comments, neither part of the essay or quoted.