arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2212.10403cs.CLcs.AI
收藏

迈向大语言模型中的推理能力:综述

Towards Reasoning in Large Language Models: A Survey

University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)

Jie Huang, Kevin Chen-Chuan Chang

AI总结:

本文综述了大语言模型推理能力的研究现状,涵盖推理能力的改进与激发技术、评估方法与基准、已有研究发现及未来方向,旨在为后续研究提供系统参考。

摘要:

推理是人类智能的一个基本方面,在问题解决、决策制定和批判性思维等活动中发挥着关键作用。近年来,大语言模型(LLMs)在自然语言处理方面取得了显著进展,且有观察表明,当这些模型规模足够大时,它们可能表现出推理能力。然而,目前尚不清楚LLMs在多大程度上具备推理能力。本文全面概述了关于LLMs推理能力的当前知识状况,包括改进和激发这些模型推理能力的技术、评估推理能力的方法和基准、该领域以往研究的发现与启示,以及对未来方向的建议。我们的目标是提供对该主题详细且最新的综述,并激发有意义的讨论和未来工作。

英文摘要:

Reasoning is a fundamental aspect of human intelligence that plays a crucial role in activities such as problem solving, decision making, and critical thinking. In recent years, large language models (LLMs) have made significant progress in natural language processing, and there is observation that these models may exhibit reasoning abilities when they are sufficiently large. However, it is not yet clear to what extent LLMs are capable of reasoning. This paper provides a comprehensive overview of the current state of knowledge on reasoning in LLMs, including techniques for improving and eliciting reasoning in these models, methods and benchmarks for evaluating reasoning abilities, findings and implications of previous research in this field, and suggestions on future directions. Our aim is to provide a detailed and up-to-date review of this topic and stimulate meaningful discussion and future work.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑