Reasoning is a fundamental aspect of human intelligence that plays a crucial role in activities such as problem solving, decision making, and critical thinking. In recent years, large language models (LLMs) have made significant progress in natural language processing, and there is observation that these models may exhibit reasoning abilities when they are sufficiently large. However, it is not yet clear to what extent LLMs are capable of reasoning. This paper provides a comprehensive overview of the current state of knowledge on reasoning in LLMs, including techniques for improving and eliciting reasoning in these models, methods and benchmarks for evaluating reasoning abilities, findings and implications of previous research in this field, and suggestions on future directions. Our aim is to provide a detailed and up-to-date review of this topic and stimulate meaningful discussion and future work.
Implicit Reasoning in Large Language Models: A Comprehensive Survey
Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Jilin University(吉林大学);The Chinese University of Hong Kong(香港中文大学);Yale University(耶鲁大学)
Towards Agentic RAG with Deep Reasoning: A Survey of RAG-Reasoning Systems in LLMs
Tsinghua University(清华大学);University of Illinois Chicago(伊利诺伊大学芝加哥分校);The University of Tokyo(东京大学);Peking University(北京大学);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);University of California, Los Angeles(加利福尼亚大学洛杉矶分校);HKUST(香港科技大学)
Harnessing the Reasoning Economy: A Survey of Efficient Reasoning for Large Language Models
The Chinese University of Hong Kong(香港中文大学);University of Macau(澳门大学);The University of Hong Kong(香港大学);Princeton University(普林斯顿大学);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)
Puzzle Solving using Reasoning of Large Language Models: A Survey
Artificial Intelligence and Learning Systems Laboratory(人工智能与学习系统实验室);School of Electrical and Computer Engineering(电气与计算机工程学院);National Technical University of Athens(希腊雅典国家技术大学)
A Survey of Inductive Reasoning for Large Language Models
East China Normal University(华东师范大学);Shanghai Innovation Institute(上海创新研究院);Fudan University(复旦大学);Xi’an Jiaotong University(西安交通大学);Shanghai AI Laboratory(上海人工智能实验室)
A Survey of Task-Oriented Knowledge Graph Reasoning: Status, Applications, and Prospects
School of Artificial Intelligence, Beihang University(北航人工智能学院);School of Information Science and Technology, Beijing Forestry University(北京林业大学信息科学与技术学院)
A Survey on Large Language Models for Mathematical Reasoning
National Key Laboratory for Novel Software Technology(国家新型软件技术重点实验室);School of Artificial Intelligence(人工智能学院);Nanyang Technological University(南洋理工大学);Skywork AI Singapore(Skywork AI新加坡);The Chinese University of Hong Kong Shenzhen(香港中文大学(深圳))
Mitigating Hallucination in Large Language Models: A Capability-Oriented Survey on RAG, Reasoning, and Agentic Systems
Electronic Information School, Wuhan University(武汉大学电子信息学院);School of Computing, Dublin City University(都柏林城市大学计算机学院);School of Public Health, Wuhan University(武汉大学公共卫生学院);Insight Centre for Data Analytics, University of Galway(Galway大学数据分析研究中心);Insight Centre for Data Analytics, Dublin City University(都柏林城市大学数据分析研究中心)
Medical Reasoning with Large Language Models: A Survey and MR-Bench
University of Science and Technology of China(中国科学技术大学);The First Affiliated Hospital of USTC(中国科学技术大学附属第一医院);National University of Singapore(新加坡国立大学)
Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Models
LARG;Research Center for Social Computing and Interactive Robotics(社会计算与交互机器人研究中心);Harbin Institute of Technology(哈尔滨工业大学);School of Computer Science and Engineering, Central South University(中南大学计算机科学与工程学院);The University of Hong Kong(香港大学);Fudan University(复旦大学)
LLM-based Agentic Reasoning Frameworks: A Survey from Methods to Scenarios
Beijing Jiaotong University(北京交通大学);Lancaster University(兰卡斯特大学);Max Planck Institute for Informatics, Saarland Informatics Campus(马克斯·普朗克研究所(信息学)萨尔兰州信息学校区);University of Electronic Science and Technology of China(电子科技大学)
Reasoning Beyond Language: A Comprehensive Survey on Latent Chain-of-Thought Reasoning
Department of Computing, The Hong Kong Polytechnic University(计算机系,香港理工大学);Ningbo Digital Twin Institute, Eastern Institute of Technology(宁波数字孪生研究院,东部技术研究所)
A Comprehensive Survey on Trustworthiness in Reasoning with Large Language Models
School of Artificial Intelligence, University of Chinese Academy of Sciences(人工智能学院,中国科学院大学);NLPR & MAIS, Institute of Automation, Chinese Academy of Sciences(神经语言处理与机器智能中心,中国科学院自动化研究所)
Reasoning LLMs in the Medical Domain: A Literature Survey
Fraunhofer IAIS - Department of Media Engineering(弗劳恩霍夫研究所媒体工程部门);University of Bonn - Department of Computer Science(波恩大学计算机科学系);West-AI - Federal Ministry of Education and Research(西德人工智能 - 教育与研究部)
A Survey of Mathematical Reasoning in the Era of Multimodal Large Language Model: Benchmark, Method & Challenges
The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));The Hong Kong University of Science and Technology(香港科技大学);Nanyang Technological University(南洋理工大学);Squirrel Ai Learning(松鼠Ai学习)