Wrong-of-Thought: An Integrated Reasoning Framework with Multi-Perspective Verification and Wrong Information
School of Computer Science and Engineering, Central South University(中南大学计算机科学与工程学院);Research Center for SCIR, Harbin Institute of Technology(哈尔滨工业大学SCIR研究中心);Qilu University of Technology (Shandong Academy of Sciences)(齐鲁工业大学(山东省科学院));Yunnan University(云南大学)
思维链(Chain-of-Thought, CoT)已成为提升大语言模型(Large Language Models, LLMs)性能的关键技术,受到研究者越来越多的关注。一类方法通过持续验证并优化LLMs的推理输出以达到预期质量,实现LLMs的迭代增强。尽管这类方法效果显著,但该范式存在两个关键问题:(1)验证方法单一:当前范式仅依赖单一的验证方法;(2)错误信息被忽视:传统范式在推理过程中直接忽略错误信息,每次都要从头重构逻辑路径。为应对这些挑战,我们提出Wrong-of-Thought(WoT)框架,包含两个核心模块:(1)多视角验证:一种多视角验证方法,用于精准优化推理过程与结果;(2)错误信息利用:利用错误信息对LLMs进行警示,降低其重复犯错的概率。在8个主流数据集和5个LLMs上的实验表明,WoT优于所有现有基线方法。此外,WoT在高难度计算任务中展现出强大的能力。
英文摘要:
Chain-of-Thought (CoT) has become a vital technique for enhancing the performance of Large Language Models (LLMs), attracting increasing attention from researchers. One stream of approaches focuses on the iterative enhancement of LLMs by continuously verifying and refining their reasoning outputs for desired quality. Despite its impressive results, this paradigm faces two critical issues: (1) Simple verification methods: The current paradigm relies solely on a single verification method. (2) Wrong Information Ignorance: Traditional paradigms directly ignore wrong information during reasoning and refine the logic paths from scratch each time. To address these challenges, we propose Wrong-of-Thought (WoT), which includes two core modules: (1) Multi-Perspective Verification: A multi-perspective verification method for accurately refining the reasoning process and result, and (2) Wrong Information Utilization: Utilizing wrong information to alert LLMs and reduce the probability of LLMs making same mistakes. Experiments on 8 popular datasets and 5 LLMs demonstrate that WoT surpasses all previous baselines. In addition, WoT exhibits powerful capabilities in difficult computation tasks.
Hong Kong University of Science and Technology (Guangzhou)(香港科学与技术大学(广州));University of Pennsylvania(宾夕法尼亚大学);Huazhong University of Science and Technology(华中科技大学);Hong Kong Polytechnic University(香港理工大学);RLWRLD
CHECKWHY: Causal Fact Verification via Argument Structure
Shandong Computer Science Center, Qilu University of Technology (Shandong Academy of Sciences)(齐鲁工业大学(山东省科学院)山东省计算机科学中心);School of Computer Science and Engineering, Southeast University(东南大学计算机科学与工程学院)
SIFT: Robust Meta-Faithfulness Verification of Chain-of-Thought Reasoning Under Distribution Shift
Istanbul Technical University(伊斯坦布尔理工大学);Pabna University of Science and Technology(帕布纳科技大学);American International University-Bangladesh(美国国际大学-孟加拉);Deakin University(迪肯大学);North South University(南北大学)
CoTJudger: A Graph-Driven Framework for Automatic Evaluation of Chain-of-Thought Efficiency and Redundancy in LRMs
University of Science and Technology of China(科学技术大学);Shenzhen University of Advanced Technology(深圳先进技术大学);Shenzhen Institutes of Advanced Technology, CAS(深圳先进技术研究所,中国科学院);Southeast University(东南大学);Nanjing University(南京大学);Beihang University(北航);University of Manchester(曼彻斯特大学)
Cognitive Loop of Thought: Reversible Hierarchical Markov Chain for Efficient Mathematical Reasoning
School of Computer Science and Technology, East China Normal University(1 计算机科学与技术学院,华东师范大学);School of Electronic and Electrical Engineering, Shanghai University of Engineering Science(2 电子电气工程学院,上海工程技术大学)
Nagoya University(名古屋大学);Nara Institute of Science and Technology(奈良科学技術大學);Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);RIKEN AIP(理化学研究所(AIP))
NCV: A Node-Wise Consistency Verification Approach for Low-Cost Structured Error Localization in LLM Reasoning
Beijing University of Posts and Telecommunications(北京邮电大学);Shanghai Jiao Tong University(上海交通大学);Ant Group(蚂蚁集团);Tsinghua University(清华大学);Inner Mongolia Research Institute of SJTU(内蒙古大学SJTU研究所)
ProvenanceGuard: Source-Aware Factuality Verification for MCP-Based LLM Agents
Multiverse Computing;Parque Cientifico y Tecnológico de Gipuzkoa(吉普斯夸科技园);Centre for Social Innovation(社会创新中心);Donostia International Physics Center(多诺斯蒂亚国际物理中心);Ikerbasque Foundation for Science(伊克尔巴斯克科学基金会)
Pause and Reflect: Conformal Aggregation for Chain-of-Thought Reasoning
Department of Mathematics and Statistics(数学与统计学系);McGill University(麦吉尔大学);Department of Mathematics and Industrial Engineering(数学与工业工程系);Polytechnique de Montréal(蒙特利尔理工学院)