The BaseResearcharXiv

Humans Correct Their Judgments Through Debate, but Weaker AI Models Do Not

A team led by Maria Victoria Carro tests AI Safety via Debate, in which two AI debaters argue opposite answers before a judge. With 507 human participants and over 40 LLM experiments, they report debate improved human accuracy but gave weaker language-model judges little consistent gain.

Open the source ↗
About Anthropic or ClaudeClaude, made by Anthropic, wrote this entry. It follows the same rules as every other entry, whoever the entry is about.

Why it matters

The same thing, for different readers.

What it means for you

Researchers found that people shown two AI systems arguing opposite sides got more answers right, while weaker AI judges did not reliably improve.

For lawmakers

The authors' results suggest regulators or labs should not assume automated AI judges can stand in for human oversight when overseeing systems more capable than the judge.

For researchers

The Carro team reports debate helped human judges and not weaker LLM judges, and that voting beat deliberation, adding empirical weight to debate as a scalable-oversight method with human judges.

The question it raises

The authors note human judgment is not neutral, so a debate protocol is only as good as the biases of the people judging it.

In their own words

Every quotation was found, word for word, in the text we saved from the source. That shows the words are there; it does not make them true, or prove the speaker meant them as quoted.

From the source’s own text.

“For weaker language models, however, the results are mixed: debate provides no comparable gains across most settings, with effects ranging from significant improvements to declines in accuracy.”
Maria Victoria Carro, Università degli Studi di Genova; FAIR, IALAB, Universidad de Buenos AiresSummary of the LLM-judge experiments in the introduction, after the authors report accuracy gains for human judges.
Found word for word in the source
“For LLM supervisors, however, none of them significantly improves group accuracy, even as the number of judges increases.”
Maria Victoria Carro, Università degli Studi di Genova; FAIR, IALAB, Universidad de Buenos AiresResult on multi-judge protocols (voting, deliberation) with language-model judges, contrasted with human groups.
Found word for word in the source
“Notably, in non-diverse deliberation panels, grounded minority judges abandon their initial answers more often than erroneous minority judges adopt the correct answer, even when the grounded minority judges report greater confidence in their pre-deliberation positions.”
Maria Victoria Carro, Università degli Studi di Genova; FAIR, IALAB, Universidad de Buenos AiresThe authors' observation about deliberation among identical judges, where they say incorrect positions may be more persuasive.
Found word for word in the source
“Taken together, these findings provide evidence supporting Debate as a viable path toward scalable human oversight, while casting doubt on the assumption that such benefits translate to weaker AI supervisors, raising concerns about the reliability of fully automated training and control pipelines in high-stakes AI safety contexts.”
Maria Victoria Carro, Università degli Studi di Genova; FAIR, IALAB, Universidad de Buenos AiresThe authors' overall reading of their results at the end of the introduction.
Found word for word in the source

How the finding was reached

In our words, from the source. Weigh the finding by how it was made.

What was done
Debates by Claude Opus 4.5 on 10 scientific and technological topics, judged before and after by 507 non-expert human participants (recruited through Prolific, five between-subjects conditions) and by eight proprietary and open-source LLM judges in over 40 experiments, including consultancy baselines, single-judge and multi-judge voting or deliberation protocols.
What it found
For human judges, debate raised accuracy relative to prior beliefs from 41.3% to 57.6% (p=.028) while consultancy did not; weighted voting among humans rose from 45.8% to 65.3%. For weaker LLM judges, results were mixed, for example GPT-5.2 rose from 84.85% to 90.40% and Claude Sonnet 4 fell from 85.26% to 78.95%.
What it does not show
The authors call their benchmark-based measure of debater-judge capability asymmetry limited, with no privileged information given to debaters. Some effects, such as multi-human deliberation, did not survive multiple-comparison correction, and human groups are small.
Status
A preprint: not yet peer reviewed. Data and code are said to be on a public GitHub repository; the paper is described as an extended version of a NeurIPS 2026 paper. No independent replication is reported.

The record

Questions
Are AI companies putting stronger safeguards into practice? · Can AI systems act beyond what people intended or allowed?
People
Maria Victoria Carro (Wrote it, Università degli Studi di Genova; FAIR, IALAB, Universidad de Buenos Aires) · Maria Vanina Martinez (Wrote it) · Gerardo Simari (Wrote it)
What we read
We read the whole source.
Found by
The Radar, run of October 21, 2026, via arxiv-ai-safety-query (tier 1: the source’s own channel or an official record)
Cite this
arXiv, “Humans Correct Their Judgments Through Debate, but Weaker AI Models Do Not”, October 20, 2026. Entry in the Ctrl AI Base, https://ctrlai.com/base/arxiv-2026-10-20-humans-correct-judgments-debate-weaker-ai
Our notesThe paper uses Claude Opus 4.5 as debater and Claude Sonnet 4 as one judge; it is not about Anthropic, so conflict is false. 17 authors are listed; only the first and two senior-looking names were added and roles for the others are not given. The author-position mapping to affiliations was not clear from the extracted text. Several p-values are Holm-corrected as printed.