arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2603.28488cs.CLcs.AIcs.MA
收藏

courtroom 风格多智能体辩论与渐进式 RAG 和角色切换用于争议性主张验证

Courtroom-Style Multi-Agent Debate with Progressive RAG and Role-Switching for Controversial Claim Verification

Systems and Software Lab (SSL), Department of Computer Science and Engineering(系统与软件实验室(SSL),计算机科学与工程系)

Masnun Nuha Chowdhury, Nusrat Jahan Beg, Umme Hunny Khan, Syed Rifat Raiyan, Md Kamrul Hasan, Hasan Mahmud

AI总结:

本文提出 PROClaim 框架,通过结构化对抗辩论和角色切换提升争议性主张验证的可靠性,实验显示其在 Check-COVID 数据集上准确率达 81.7%。

摘要:

大型语言模型 (LLMs) 由于幻觉和浅层推理在高风险主张验证中仍不可靠。虽然检索增强生成 (RAG) 和多智能体辩论 (MAD) 有所改进,但受限于单次检索和无结构辩论动态。我们提出 courtroom 风格多智能体框架 PROClaim,将验证重新公式化为结构化、对抗性辩论。我们的方法整合了专门角色 (例如原告、辩护方、法官) 与渐进式 RAG (P-RAG) 来动态扩展和细化证据池。此外,我们采用证据谈判、自我反思和异质多法官聚合来强制校准、鲁棒性和多样性。在零样本评估中,PROClaim 在 Check-COVID 数据集上达到 81.7% 准确率,优于标准多智能体辩论 10.0 个百分点,其中 P-RAG 推动了主要性能提升 (+7.5 pp)。我们最终证明,结构化辩论和模型异质性有效缓解系统性偏差,为可靠的主张验证提供稳健基础。我们的代码和数据在 https://github.com/mnc13/PROClaim 上公开。

英文摘要:

Large language models (LLMs) remain unreliable for high-stakes claim verification due to hallucinations and shallow reasoning. While retrieval-augmented generation (RAG) and multi-agent debate (MAD) address this, they are limited by one-pass retrieval and unstructured debate dynamics. We propose a courtroom-style multi-agent framework, PROClaim, that reformulates verification as a structured, adversarial deliberation. Our approach integrates specialized roles (e.g., Plaintiff, Defense, Judge) with Progressive RAG (P-RAG) to dynamically expand and refine the evidence pool during the debate. Furthermore, we employ evidence negotiation, self-reflection, and heterogeneous multi-judge aggregation to enforce calibration, robustness, and diversity. In zero-shot evaluations on the Check-COVID benchmark, PROClaim achieves 81.7% accuracy, outperforming standard multi-agent debate by 10.0 percentage points, with P-RAG driving the primary performance gains (+7.5 pp). We ultimately demonstrate that structural deliberation and model heterogeneity effectively mitigate systematic biases, providing a robust foundation for reliable claim verification. Our code and data are publicly available at https://github.com/mnc13/PROClaim.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑