基于大语言模型(LLM)的智能体存在幻觉问题:分类、方法与方向综述
LLM-based Agents Suffer from Hallucinations: A Survey of Taxonomy, Methods, and Directions
AI总结:
本文首次全面综述基于LLM的智能体幻觉问题,通过分析智能体工作流程提出新分类法,研究18个触发原因,总结缓解与检测方法并指出未来方向,旨在推动更可靠的智能体系统发展。
摘要:
在大语言模型(LLMs)快速发展的推动下,基于LLM的智能体已成为具备类人认知、推理和交互能力的强大智能系统,正越来越多地应用于学生教育、科学研究和金融分析等各类现实场景。然而,尽管潜力显著,基于LLM的智能体仍易受幻觉问题影响,可能导致任务执行错误,削弱整体系统设计的可靠性。应对这一关键挑战需要深入理解并系统整合基于LLM的智能体的最新进展。为此,我们首次提出关于基于LLM的智能体幻觉问题的全面综述。通过仔细分析智能体的完整工作流程,我们提出一种新的分类法,识别出不同阶段出现的各类智能体幻觉。此外,我们深入研究了导致智能体幻觉出现的18个触发原因。通过详细回顾大量现有研究,我们总结了幻觉缓解与检测的方法,并指出未来研究的潜在方向。我们希望本综述能激发更多解决基于LLM的智能体幻觉问题的努力,最终推动更稳健、可靠的智能体系统的发展。
英文摘要:
Driven by the rapid advancements of Large Language Models (LLMs), LLM-based agents have emerged as powerful intelligent systems capable of human-like cognition, reasoning, and interaction. These agents are increasingly being deployed across diverse real-world applications, including student education, scientific research, and financial analysis. However, despite their remarkable potential, LLM-based agents remain vulnerable to hallucination issues, which can result in erroneous task execution and undermine the reliability of the overall system design. Addressing this critical challenge requires a deep understanding and a systematic consolidation of recent advances on LLM-based agents. To this end, we present the first comprehensive survey of hallucinations in LLM-based agents. By carefully analyzing the complete workflow of agents, we propose a new taxonomy that identifies different types of agent hallucinations occurring at different stages. Furthermore, we conduct an in-depth examination of eighteen triggering causes underlying the emergence of agent hallucinations. Through a detailed review of a large number of existing studies, we summarize approaches for hallucination mitigation and detection, and highlight promising directions for future research. We hope this survey will inspire further efforts toward addressing hallucinations in LLM-based agents, ultimately contributing to the development of more robust and reliable agent systems.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。