Maria Victoria Carro
Università degli Studi di Genova; FAIR, IALAB, Universidad de Buenos Aires
Titles as the sources gave them. In 1 entry, with 4 checked quotations.
What they said
Newest first. Each quotation was found word for word in the source.
“For weaker language models, however, the results are mixed: debate provides no comparable gains across most settings, with effects ranging from significant improvements to declines in accuracy.”
“For LLM supervisors, however, none of them significantly improves group accuracy, even as the number of judges increases.”
“Notably, in non-diverse deliberation panels, grounded minority judges abandon their initial answers more often than erroneous minority judges adopt the correct answer, even when the grounded minority judges report greater confidence in their pre-deliberation positions.”
“Taken together, these findings provide evidence supporting Debate as a viable path toward scalable human oversight, while casting doubt on the assumption that such benefits translate to weaker AI supervisors, raising concerns about the reliability of fully automated training and control pipelines in high-stakes AI safety contexts.”
In the Base
Every entry they appear in.
Humans Correct Their Judgments Through Debate, but Weaker AI Models Do Not
A team led by Maria Victoria Carro tests AI Safety via Debate, in which two AI debaters argue opposite answers before a judge. With 507 human participants and over 40 LLM experiments, they report debate improved human accuracy but gave weaker language-model judges little consistent gain.