arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2407.09417cs.CLcs.IR
收藏

缓解大语言模型中的实体级幻觉

Mitigating Entity-Level Hallucination in Large Language Models

Tsinghua University(清华大学);Beijing Institute of Technology(北京理工大学)

Weihang Su, Yichen Tang, Qingyao Ai, Changyue Wang, Zhijing Wu, Yiqun Liu

AI总结:

本文提出DRAD方法,通过实时幻觉检测和外部知识自我纠正,动态调整检索增强,以检测并缓解大语言模型中的实体级幻觉,实验证明其性能优越。

摘要:

大语言模型(LLMs)的出现彻底改变了用户获取信息的方式,从传统的搜索引擎转向与LLMs的直接问答交互。然而,LLMs的广泛采用揭示了一个被称为幻觉的重大挑战,即LLMs生成连贯但事实不准确的响应。这种幻觉现象导致用户对基于LLMs的信息检索系统产生不信任。为解决这一挑战,本文提出了一种基于幻觉检测的动态检索增强(DRAD)方法,作为检测和缓解LLMs中幻觉的新方法。DRAD在传统检索增强的基础上进行了改进,通过根据实时幻觉检测动态调整检索过程。它包含两个主要组件:实时幻觉检测(RHD),用于在无需外部模型的情况下识别潜在幻觉;以及基于外部知识的自我纠正(SEK),用于利用外部知识纠正这些错误。实验结果表明,DRAD在检测和缓解LLMs中的幻觉方面均表现出优越性能。我们的所有代码和数据已在https://github.com/oneal2000/EntityHallucination开源。

英文摘要:

The emergence of Large Language Models (LLMs) has revolutionized how users access information, shifting from traditional search engines to direct question-and-answer interactions with LLMs. However, the widespread adoption of LLMs has revealed a significant challenge known as hallucination, wherein LLMs generate coherent yet factually inaccurate responses. This hallucination phenomenon has led to users' distrust in information retrieval systems based on LLMs. To tackle this challenge, this paper proposes Dynamic Retrieval Augmentation based on hallucination Detection (DRAD) as a novel method to detect and mitigate hallucinations in LLMs. DRAD improves upon traditional retrieval augmentation by dynamically adapting the retrieval process based on real-time hallucination detection. It features two main components: Real-time Hallucination Detection (RHD) for identifying potential hallucinations without external models, and Self-correction based on External Knowledge (SEK) for correcting these errors using external knowledge. Experiment results show that DRAD demonstrates superior performance in both detecting and mitigating hallucinations in LLMs. All of our code and data are open-sourced at https://github.com/oneal2000/EntityHallucination.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑