Large language models (LLMs) with billions of parameters exhibit in-context learning abilities, enabling few-shot learning on tasks that the model was not specifically trained for. Traditional models achieve breakthrough performance on language tasks, but do not perform well on basic reasoning benchmarks. However, a new in-context learning approach, Chain-of-thought, has demonstrated strong multi-step reasoning abilities on these benchmarks. The research on LLM reasoning abilities started with the question whether LLMs can solve grade school math word problems, and has expanded to other tasks in the past few years. This article reviews the field of multi-step reasoning with LLMs. We propose a taxonomy that identifies different ways to generate, evaluate, and control multi-step reasoning. We provide an in-depth coverage of core approaches and open problems, and we propose a research agenda for the near future. We find that multi-step reasoning approaches have progressed beyond math word problems, and can now successfully solve challenges in logic, combinatorial games, and robotics, sometimes by first generating code that is then executed by external tools. Many studies in multi-step methods use reinforcement learning for finetuning, external optimization loops, in-context reinforcement learning, and self-reflection.
Implicit Reasoning in Large Language Models: A Comprehensive Survey
Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Jilin University(吉林大学);The Chinese University of Hong Kong(香港中文大学);Yale University(耶鲁大学)
Beyond Imitation: Learning Key Reasoning Steps from Dual Chain-of-Thoughts in Reasoning Distillation
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络空间安全学院)
Towards Agentic RAG with Deep Reasoning: A Survey of RAG-Reasoning Systems in LLMs
Tsinghua University(清华大学);University of Illinois Chicago(伊利诺伊大学芝加哥分校);The University of Tokyo(东京大学);Peking University(北京大学);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);University of California, Los Angeles(加利福尼亚大学洛杉矶分校);HKUST(香港科技大学)
Harnessing the Reasoning Economy: A Survey of Efficient Reasoning for Large Language Models
The Chinese University of Hong Kong(香港中文大学);University of Macau(澳门大学);The University of Hong Kong(香港大学);Princeton University(普林斯顿大学);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)
Puzzle Solving using Reasoning of Large Language Models: A Survey
Artificial Intelligence and Learning Systems Laboratory(人工智能与学习系统实验室);School of Electrical and Computer Engineering(电气与计算机工程学院);National Technical University of Athens(希腊雅典国家技术大学)
A Survey of Inductive Reasoning for Large Language Models
East China Normal University(华东师范大学);Shanghai Innovation Institute(上海创新研究院);Fudan University(复旦大学);Xi’an Jiaotong University(西安交通大学);Shanghai AI Laboratory(上海人工智能实验室)
A Survey of Task-Oriented Knowledge Graph Reasoning: Status, Applications, and Prospects
School of Artificial Intelligence, Beihang University(北航人工智能学院);School of Information Science and Technology, Beijing Forestry University(北京林业大学信息科学与技术学院)
A Survey on Large Language Models for Mathematical Reasoning
National Key Laboratory for Novel Software Technology(国家新型软件技术重点实验室);School of Artificial Intelligence(人工智能学院);Nanyang Technological University(南洋理工大学);Skywork AI Singapore(Skywork AI新加坡);The Chinese University of Hong Kong Shenzhen(香港中文大学(深圳))
Mitigating Hallucination in Large Language Models: A Capability-Oriented Survey on RAG, Reasoning, and Agentic Systems
Electronic Information School, Wuhan University(武汉大学电子信息学院);School of Computing, Dublin City University(都柏林城市大学计算机学院);School of Public Health, Wuhan University(武汉大学公共卫生学院);Insight Centre for Data Analytics, University of Galway(Galway大学数据分析研究中心);Insight Centre for Data Analytics, Dublin City University(都柏林城市大学数据分析研究中心)
Medical Reasoning with Large Language Models: A Survey and MR-Bench
University of Science and Technology of China(中国科学技术大学);The First Affiliated Hospital of USTC(中国科学技术大学附属第一医院);National University of Singapore(新加坡国立大学)
The Impact of Reasoning Step Length on Large Language Models
Rutgers University(罗格斯大学);University of Liverpool(利物浦大学);Northwestern University(西北大学);New Jersey Institute of Technology(新泽西理工学院);University of Exeter(埃克塞特大学)