Multi-agent strategies have emerged as a promising approach to enhance the reasoning abilities of Large Language Models (LLMs) by assigning specialized roles in the problem-solving process. Concurrently, Tree of Thoughts (ToT) methods have shown potential in improving reasoning for complex question-answering tasks by exploring diverse reasoning paths. A critical limitation in multi-agent reasoning is the 'Reasoner' agent's shallow exploration of reasoning paths. While ToT strategies could help mitigate this problem, they may generate flawed reasoning branches, which could harm the trustworthiness of the final answer. To leverage the strengths of both multi-agent reasoning and ToT strategies, we introduce a novel approach combining ToT-based Reasoner agents with a Thought Validator agent. Multiple Reasoner agents operate in parallel, employing ToT to explore diverse reasoning paths. The Thought Validator then scrutinizes these paths, considering a Reasoner's conclusion only if its reasoning is valid. This method enables a more robust voting strategy by discarding faulty reasoning paths, enhancing the system's ability to tackle tasks requiring systematic and trustworthy reasoning. Our method demonstrates superior performance compared to existing techniques when evaluated on the GSM8K dataset, outperforming the standard ToT strategy by an average 5.6% across four LLMs. The code and related content can be found in: https://github.com/SecureAIAutonomyLab/MA-ToT
DocVAL: Validated Chain-of-Thought Distillation for Grounded Document VQA
Department of Computer Science(计算机科学系);Engineering, Ohio State University, Ohio, US(工程系,俄亥俄州立大学,俄亥俄,美国);Department of Computer Science, University of Central Florida, Florida, US(计算机科学系,中央佛罗里达大学,佛罗里达,美国)
CAP-CoT: Cycle Adversarial Prompt for Improving Chain of Thoughts in LLM Reasoning
Department of Electronic Engineering, Kyung Hee University(韩国庆熙大学电子工程系);School of Computer Science and Engineering, University of Electronic Science and Technology of China(中国电子科技大学计算机科学与工程学院);Henan Polytechnic University(河南理工大学);School of Computing, Kyung Hee University(韩国庆熙大学计算机学院)
Direct Value Optimization: Improving Chain-of-Thought Reasoning in LLMs with Refined Values
Zhejiang University(浙江大学);School of Engineering, Westlake University(西湖大学工程学院);Institute of Advanced Technology, Westlake Institute for Advanced Study(西湖高等研究院先进技术研究所);University College London(伦敦大学学院)
Are Reasoning LLMs Robust to Interventions on Their Chain-of-Thought?
Helmholtz Munich(海德堡-慕尼黑研究所);Ludwig Maximilian University of Munich(慕尼黑路德维希-马克西米利安大学);Technical University of Munich, Munich Center for Machine Learning (MCML)(慕尼黑技术大学,慕尼黑机器学习中心)
Rethinking the Chain-of-Thought: The Roles of In-Context Learning and Pre-trained Priors
School of Intelligence Science and Technology, National Key Laboratory for Novel Software Technology, Nanjing University(智能科学与技术学院,新型软件技术国家重点实验室,南京大学);School of Computing and Information Systems, Singapore Management University(计算与信息系统学院,新加坡管理大学);Central South University(中南大学);School of Global Education and Development, International Chinese Language Education, University of Chinese Academy of Social Sciences(全球教育与发展学院,国际中文教育,中国社会科学院)
Think Consistently, Reason Efficiently: Energy-Based Calibration for Implicit Chain-of-Thought
University of Oxford(牛津大学);Tsinghua University(清华大学);Tencent(腾讯);Southern University of Science and Technology(南方科技大学);National University of Singapore(新加坡国立大学)
GEMeX-RMCoT: An Enhanced Med-VQA Dataset for Region-Aware Multimodal Chain-of-Thought Reasoning
The Hong Kong Polytechnic University(香港理工大学);Shenzhen University(深圳大学);West China Hospital of Sichuan University(四川大学华西医院);IHPC, Agency for Science, Technology and Research(科技研究局IHPC)
NTS-CoT: Mitigating Hallucinations in LLM-based News Timeline Summarization with Chain-of-Thought Reasoning
Central South University(中南大学);Tsinghua University(清华大学);Nanjing University(南京大学);Suzhou Aerospace Information Research Institute(苏州空天信息研究院);McGill University(麦吉尔大学)
Understanding Reasoning in Chain-of-Thought from the Hopfieldian View
King Abdullah University of Science and Technology(阿卜杜拉国王科技大学);Soochow University(苏州大学);University of Southampton(南安普顿大学);Arizona State University(亚利桑那州立大学)
Brain-Inspired Two-Stage Approach: Enhancing Mathematical Reasoning by Imitating Human Thought Processes
School of Information Science and Technology, ShanghaiTech University(上海科技大学信息科学与技术学院);Shanghai Innovation Center for Processor Technologies(上海处理器技术创新中心);School of Information Science and Technology, University of Science and Technology of China(中国科学技术大学信息科学与技术学院)