Yoshua Bengio
Turing Award winner · Co-president, LawZero; Professor, Université de Montreal
Titles as the sources gave them. In 4 entries, with 6 checked quotations.
Who they are
Roles and parties from Wikidata and from the sources in the Base, as precise as each gives them. When we compare what groups say, each statement counts in the group the person belonged to that day.
What they said
Newest first. Each quotation was found word for word in the source.
“With the OpenAI agents, there is reason to believe successful cheating was actually rewarded: When the scoring program does not see the cheating, it pays out anyway, and such cheats become more likely next time”
“If you truly prioritize safety, it is time for you to leave frontier AI companies. Work for an AI Safety Institute. Join a mission driven organization that practices what it preaches.”
“Safety efforts at the companies are not sufficiently slowing a dangerous race, as they sometimes conflict with their main goal of making the next model easier to ship.”
“The actions taken by the CEOs of the big labs are not the actions of leaders who truly believe they have a choice.”
“I reject these arguments. And I do not believe we are on track to see sufficient government regulation in time, even while the companies ask for it.”
“I fell into the trap of motivated reasoning, believing what I needed to believe so that I could keep doing the work I loved.”
In the Base
Every entry they appear in.
OpenAI discloses four more rogue AI incidents involving financial, medical, and government data
Fortune reports that OpenAI added four incidents of misbehaving internal AI agents to its disclosure page, bringing the total to 19. Two are marked critical: a bypass of a government website's access controls and changes to a live internal system. OpenAI says it has tightened security and grading.
AI Safety Is Not A Corporate Plot
In an essay, Scott Alexander argues that claims AI companies exaggerate danger for stock prices, distraction or regulatory capture are false. The case rests on unaffiliated experts sharing the concern, leaders voicing it before their firms existed, and market and coalition evidence that the supposed plots would backfire.
Governing AI Agents: Alan Chan of GovAI on Monitoring, Agent IDs, Rogue Agents & Preparing for RSI
In a two-part, roughly 138-minute interview, GovAI's Alan Chan tells host Nathan Labenz which agent-governance proposals (monitoring, logging, agent identifiers) have been taken up, how to prepare for rogue agents, and what a paper on automated AI R&D recommends.
Bengio: ‘If you prioritize safety, leave frontier AI companies’
In an essay for Transformer, Yoshua Bengio urges researchers at frontier AI companies who put safety first to leave for safety institutes, mission-driven groups or Bengio's non-profit LawZero. Bengio argues that company safety work is not slowing a dangerous race, rejects the case for racing China and rival firms, and doubts regulation will arrive in time.