Chain of thought (CoT) is a reasoning framework that can enhance the performance of Large Language Models (LLMs) on complex inference tasks. In particular, among various studies related to CoT, multi-path inference stands out as a simple yet effective improvement. However, there is no optimal setting for the number of inference paths. Therefore, we have to increase the number of inference paths to obtain better results, which in turn increases the inference cost. To address this limitation, we can utilize question-related role templates to guide LLMs into relevant roles, thereby increasing the possibility of correct inferences for each path and further reducing dependence on the number of inference paths while improving reasoning accuracy. However, placing LLMs into specific roles may reduce their reasoning diversity and performance on a few tasks where role dependence is low. To alleviate the excessive immersion of the LLM into a specific role, we propose Nash CoT by constructing a game system on each path that balances the generation from role-specific LLMs' and the general LLMs' generation, thereby ensuring both effective role adoption and diversity in LLM generation further maintaining the performance of multi-path inference while reducing the requirement of the number of inference paths. We evaluate Nash CoT across various inference tasks, including Arabic Reasoning, Commonsense Question Answering, and Symbolic Inference, achieving results that are comparable to or better than those of multi-path CoT with the equal number of inference paths.
Stanford University(斯坦福大学);Georgia Institute of Technology(佐治亚理工学院);The University of Tokyo(东京大学);RIKEN AIP(日本理化学研究所智能系统研究中心);Pennsylvania State University(宾夕法尼亚州立大学);University of California, Los Angeles(加州大学洛杉矶分校);Harvard University(哈佛大学);UNC–Chapel Hill(北卡罗来纳大学教堂山分校)
Uncovering the Impact of Chain-of-Thought Reasoning for Direct Preference Optimization: Lessons from Text-to-SQL
Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学高瓴人工智能学院);School of Information, Renmin University of China(中国人民大学信息学院);China Mobile Information Technology Center(中国移动信息技术中心)
Southeast University(东南大学);Key Laboratory of New Generation Artificial Intelligence Technology and Its Interdisciplinary Applications (Southeast University) Ministry of Education(新一代人工智能技术及其交叉应用国家重点实验室);China Mobile Research Institute(中国移动研究院);Monash University(墨尔本大学);University of Manchester(曼彻斯特大学);University of Edinburgh(爱丁堡大学)
Can We Generate Images with CoT? Let's Verify and Reinforce Image Generation Step by Step
The Chinese University of Hong Kong(香港中文大学);Peking University(北京大学);Shanghai AI Laboratory(上海人工智能实验室);University of Electronic Science and Technology of China(电子科技大学)
TCPO: Thought-Centric Preference Optimization for Effective Embodied Decision-making
Tsinghua University(清华大学);Meituan(美团);Northeastern University(东北大学);Beijing University of Posts and Telecommunications(北京邮电大学);Meta AI;Wuhan University(武汉大学)
Enhancing the Reasoning Ability of Multimodal Large Language Models via Mixed Preference Optimization
OpenGVLab(开放智能机器研究实验室);Shanghai AI Laboratory(上海人工智能实验室);Fudan University(复旦大学);Nanjing University(南京大学);The Chinese University of Hong Kong(香港中文大学);Tsinghua University(清华大学);SenseTime Research(商汤科技研究院)
Unveiling the Key Factors for Distilling Chain-of-Thought Reasoning
Department of Computing, The Hong Kong Polytechnic University(香港理工大学计算机系);Ningbo Key Laboratory of Spatial Intelligence and Digital Derivative(宁波空间智能与数字衍生关键实验室);Institute of Digital Twin, EIT(数字孪生研究院);Saarland University(萨尔兰大学);Meituan Inc.(美团公司)
PRISMA: Preference-Reinforced Self-Training Approach for Interpretable Emotionally Intelligent Negotiation Dialogues
Department of Computer Science and Engineering, Indian Institute of Technology Patna, India(印度理工学院帕纳瓦分校计算机科学与工程系);School of Artificial Intelligence and Data Science, Indian Institute of Technology Jodhpur, India(印度理工学院朱道尔分校人工智能与数据科学学院)
MIND: From Passive Mimicry to Active Reasoning through Capability-Aware Multi-Perspective CoT Distillation
State Key Laboratory of Human-Machine Hybrid Augmented Intelligence, National Engineering Research Center for Visual Information and Applications, and Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University(西安交通大学人机混合增强智能国家重点实验室、视觉信息与应用国家工程研究中心、人工智能与机器人研究所);Nankai University(南开大学);The Hong Kong University of Science and Technology(Guangzhou)(香港科技大学(广州));School of Software Engineering, Xi’an Jiaotong University(西安交通大学软件学院)
MedAlign: A Synergistic Framework of Multimodal Preference Optimization and Federated Meta-Cognitive Reasoning
School of Automation, Guangdong University of Technology(广东工业大学自动化学院);College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics(南京航空航天大学计算机科学与技术学院);State Key Laboratory of Traditional Chinese Medicine Syndrome, The Second Affiliated Hospital of Guangzhou University of Chinese Medicine, Guangdong Provincial Hospital of Chinese Medicine, Guangdong Provincial Academy of Chinese Medical Sciences(广东省中医药科学院中医证候重点实验室,广州中医药大学第二附属医院,广东省中医院,广东省中医药科学院);College of Computing and Data Science, Nanyang Technological University(南洋理工大学计算机与数据科学学院);Department of Electrical and Computer Engineering, Sungkyunkwan University(成均馆大学电子与计算机工程系)