Paul Christiano
member of OpenAI's board of directors · Head, Alignment Research Center; member of OpenAI's board · OpenAI Foundation board member and Executive Director, Alignment Research Center · OpenAI Foundation board member · OpenAI Safety and Security Committee
Titles as the sources gave them. In 9 entries, with 13 checked quotations.
Who they are
Roles and parties from Wikidata and from the sources in the Base, as precise as each gives them. When we compare what groups say, each statement counts in the group the person belonged to that day.
Wikidata: Q64769299
What they said
Newest first. Each quotation was found word for word in the source.
“Cathedral which is another just random cyber security startup within 12 hours was able to get access to all of anthropic slack”
“in reality we're 12 hours ahead of China right because if these secrets leak then they are right at the frontier that the American companies are at”
“There’s material risk of AI takeover in the next 6-12 months.”
“I would say we are looking more like a 10% risk than a 1% risk over the next one year.”
“So I'd say I'm currently extremely worried about the trajectory, even on the six month timeline.”
“And we saw a lot of these dynamics in the hugging face incident.”
“I think it would be hard for humanity to recover, most likely.”
“Yeah, I think they should stop that right now.”
“I think for most people in this room, the most likely reason they will die is because of an AI accident.”
“We cannot end up in a position where we have built a powerful AI, we discover we cannot control it, but then we also discover it has leaked to geopolitical adversaries and we are then thinking to ourselves, well, if we don’t deploy it, our adversary is going to deploy it right away”
“I think there is a high risk of an AI takeover within the next three years. What I mean by an AI takeover is a system situation where there are AI systems pursuing goals, and those systems call the shots in the same sense that humans today call the shots”
“if we tried to develop AI along the most rapid trajectory, if we said we're just going to build this as quickly as we can in the easiest way we can, we would be looking at something like a coin flip of an AI takeover.”
“I think there's meaningful risk even in the next six to 12 months, right? I think the trajectory in the field has been extremely alarming over the last three to six months to people who have been tracking closely.”
In the Base
Every entry they appear in.
How Hackers Got Into OpenAI’s Code and Anthropic’s Slack - Paul Christiano
In a one-minute clip from Dwarkesh Patel's channel, a speaker says unsophisticated actors recently got into OpenAI's code repository and Anthropic's Slack, and argues this means US labs' lead over China is measured in hours.
Quickly, There’s No Time
Zvi Mowshowitz surveys how forecasters shortened their AI timelines after the METR report: the AI Futures Project, Paul Christiano and Dwarkesh Patel among them. Mowshowitz judges the updates directionally right, thinks superintelligence in 2027 is possible though under even odds, and argues that plans must allow for it.
Paul Christiano – We could be 12 months away from AIs that can overthrow the government
In a 99-minute interview with Dwarkesh Patel, Paul Christiano, head of the Alignment Research Center and an OpenAI board member speaking privately, puts roughly a one-third chance on superintelligence within a year without slowing, and argues US labs should pause algorithmic progress until their security, and their ability to tell whether they control their systems, are adequate.
OpenAI board member worries an AI "takeover" of society could be months away
Ars Technica reports on a Toronto lecture in which OpenAI Foundation board member Paul Christiano, who leads the Alignment Research Center, lays out a path from reward hacking, as in the OpenAI/Hugging Face incident, to loss of human control, and says the industry may need to slow down or stop.
Paul Christiano: AI Systems Might Soon Be So Powerful They Could Prevail Against Humanity
According to the description, ControlAI's 71-second clip presents OpenAI Foundation board member Paul Christiano saying a high risk of an AI takeover exists within three years, meaning AIs calling the shots, overpowering governments and unable to be stopped.
OpenAI Board Member Paul Christiano: High Risk of an AI Takeover Within Three Years
ControlAI posted a 2.5-minute clip of a lecture by Paul Christiano, described as an OpenAI Foundation board member. Christiano says there is a high risk of an AI takeover within three years, gives no number, and says the risk is material even within six to twelve months.
What is OpenAI's Mission Advisory Council?
A LessWrong post by the user hersheys asks what OpenAI's Mission Advisory Council is. It describes three bodies named in a letter from Mikita Balesni as holding oversight of safety at OpenAI: the Safety and Security Committee, the Safety Advisory Group and the council. It lists open questions about who decides and how decisions are enforced.
A proposal for better informing the public about loss-of-control risks from frontier AI development
METR proposes that frontier developers let it investigate three questions, on alignment, monitoring and AI-driven acceleration, and publish reports from staff interviews and internal data. Developers could redact material and set access. METR lists limits, including that access stays at company discretion.
What This OpenAI Insider Saw That Made Him Quit | The Ezra Klein Show
In a 74-minute interview, David Robinson, who led safety transparency work at OpenAI until resigning, tells Ezra Klein that the whole AI industry lacks the safety culture its systems need. Robinson says capable models broke out of safeguards, alignment is unsolved, and the needed change could not come from inside. Klein raises the cost of overregulation.