arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2601.01896cs.CLcs.AI
收藏

应对RAG中噪声过滤的固有难度

Tackling the Inherent Difficulty of Noise Filtering in RAG

Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学人工智能学院);Beijing Key Laboratory of Big Data Management and Analysis Methods(北京大数据管理与分析方法重点实验室);School of Software Tsinghua University(清华大学软件学院)

Jingyu Liu, Jiaen Lin, Yong Liu

AI总结:

本文提出了一种新的微调方法,旨在提升LLM在RAG中对相关信息和不相关信息的区分能力,从而增强模型的鲁棒性和性能。

摘要:

检索增强生成(RAG)已成为一种广泛采用的方法,通过整合外部知识和减少幻觉来增强大型语言模型(LLMs)。然而,在RAG过程中常常引入噪声或不相关文档,这可能会降低性能,甚至导致幻觉输出。尽管已经提出了各种方法来过滤此类噪声,我们认为从检索内容中识别不相关信息本质上是困难的,且有限的transformer层数难以解决这个问题。因此,检索器无法完全过滤掉不相关文档。因此,LLMs必须具备对这种噪声的鲁棒性,但我们证明标准微调方法在使模型能够选择性地利用相关信息并忽略不相关内容方面往往效果不佳,这是因为注意力模式的结构限制。为此,我们提出了一种新的微调方法,旨在增强模型在检索文档中区分相关信息和不相关信息的能力。在多个基准测试中进行的广泛实验表明,我们的方法显著提高了LLMs的鲁棒性和性能。

英文摘要:

Retrieval-Augmented Generation (RAG) has become a widely adopted approach to enhance Large Language Models (LLMs) by incorporating external knowledge and reducing hallucinations. However, noisy or irrelevant documents are often introduced during RAG, potentially degrading performance and even causing hallucinated outputs. While various methods have been proposed to filter out such noise, we argue that identifying irrelevant information from retrieved content is inherently difficult and limited number of transformer layers can hardly solve this. Consequently, retrievers fail to filter out irrelevant documents entirely. Therefore, LLMs must be robust against such noise, but we demonstrate that standard fine-tuning approaches are often ineffective in enabling the model to selectively utilize relevant information while ignoring irrelevant content due to the structural constraints of attention patterns. To address this, we propose a novel fine-tuning method designed to enhance the model's ability to distinguish between relevant and irrelevant information within retrieved documents. Extensive experiments across multiple benchmarks show that our approach significantly improves the robustness and performance of LLMs.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑