arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2504.21132cs.CLcs.LG
收藏

LLM Enhancer:使用向量嵌入结合外部知识以减少大型语言模型幻觉的合并方法

LLM Enhancer: Merged Approach using Vector Embedding for Reducing Large Language Model Hallucinations with External Knowledge

Department of Computer Science and Engineering, Jagannath University(计算机科学与工程系,贾甘纳思大学)

Naheed Rayhan, Md. Ashrafuzzaman

AI总结:

本文提出 LLM ENHANCER 系统,通过并行集成多个在线开源数据并利用向量嵌入筛选相关信息,有效减轻了大型语言模型在关键场景下的幻觉问题,同时保持了回复的自然性与准确性。

摘要:

大型语言模型(LLMs),如 ChatGPT,已展现出在各种任务(包括任务导向对话和问答)中生成类人、自然回复的能力。然而,它们在现实世界关键场景中的应用,常因倾向于产生不准确信息以及利用外部知识源的能力有限而受阻。本文介绍了 LLM ENHANCER 系统,旨在集成 Google、Wikipedia 和 DuckDuckGo 等多个在线来源以提升数据准确性。该系统采用的 LLM 均为开源模型。LLM ENHANCER 系统的数据获取过程并行运行,利用自定义智能体工具管理信息流。系统使用向量嵌入识别最相关的信息,随后将其提供给 LLM 用于用户交互。LLM ENHANCER 系统减轻了基于聊天的 LLMs 中的幻觉现象,同时保持了回复的自然性和准确性。

英文摘要:

Large Language Models (LLMs), such as ChatGPT, have demonstrated the capability to generate human like, natural responses across a range of tasks, including task oriented dialogue and question answering. However, their application in real world, critical scenarios is often hindered by a tendency to produce inaccurate information and a limited ability to leverage external knowledge sources. This paper introduces the LLM ENHANCER system, designed to integrate multiple online sources such as Google, Wikipedia, and DuckDuckGo to enhance data accuracy. The LLMs employed within this system are open source. The data acquisition process for the LLM ENHANCER system operates in parallel, utilizing custom agent tools to manage the flow of information. Vector embeddings are used to identify the most pertinent information, which is subsequently supplied to the LLM for user interaction. The LLM ENHANCER system mitigates hallucinations in chat based LLMs while preserving response naturalness and accuracy.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑