Humans Correct Their Judgments Through Debate, but Weaker AI Models Do Not
Drawing on insights from collective intelligence and social cognition, this paper investigates whether debate can guide human and LLM supervisors toward the truth despite their prior beliefs.
ProofPaper ↗
Key points
- How can we effectively oversee AI systems that surpass human intelligence?
- AI Safety via Debate proposes that two AI systems argue opposing positions and a judge, either a human or a weaker model, decides which is correct.
- However, human judgment is not neutral: people often rely on biases which advanced AI systems may learn to exploit.
- Overall, we find that debate increases accuracy relative to prior beliefs for human judges, whereas the consultancy baseline, in which a single expert argues for one answer, does not.
Sources (1)
- [1]Humans Correct Their Judgments Through Debate, but Weaker AI Models Do NotarXiv (AI, ML, NLP, CV, robotics, multi-agent) · Oct 20, 05:10 PM
Drawing on insights from collective intelligence and social cognition, this paper investigates whether debate can guide human and LLM supervisors toward the truth despite their prior beliefs.
How can we effectively oversee AI systems that surpass human intelligence?
Extractive summary: sentences quoted from the sources.
Before this
- Oct 20, 2026Gradium Open-Sources Phonon, a 31M-Parameter On-Device TTS Model Under Apache 2.0
- Oct 20, 2026Voxtral 3
- Oct 20, 2026Polarity Blindness in LLM Safety: A Systematic Study of Negation, Antonym Substitution, and Adversarial Framing
- Oct 20, 2026Do Diffusion LLMs Scale? Testing Mercury 3 + Decide
- Oct 19, 2026Introducing Clairic, a new System One class of extraction models
- Oct 19, 2026Keep the Lineages Alive: Diversity-Preserving SMC for Diffusion LLM Decoding