arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2409.13992cs.CL
收藏

SMART-RAG:用于增强检索的行列式矩阵选择

SMART-RAG: Selection using Determinantal Matrices for Augmented Retrieval

Wangxuan Institute of Computer Technology, Peking University(北京大学王选计算机研究所);Information Management Department, Peking University(北京大学信息管理系)

Jiatao Li, Xinyu Hu, Xiaojun Wan

AI总结:

本文提出SMART-RAG,一个完全无监督且无需训练的RAG上下文选择框架,利用行列式点过程同时建模相关性、多样性和冲突,有效解决了传统RAG的冗余与信息冲突问题,显著提升了问答性能。

摘要:

检索增强生成(RAG)通过整合外部信息,使大型语言模型(LLMs)能够生成准确且基于上下文的响应,从而极大地改进了这些模型。然而,传统的RAG方法仅根据查询与上下文的相关性来优先考虑排名靠前的文档,这通常会引入冗余和冲突信息。这一问题在无监督检索设置中尤为明显,由于缺乏有效缓解这些问题的机制,导致上下文选择不理想。为了解决这一问题,我们在问答任务中提出了用于增强检索的矩阵选择(SMART),这是一个完全无监督且无需训练的框架,旨在优化RAG中的上下文选择。SMART利用行列式点过程(DPPs)来同时建模相关性、多样性和冲突,确保选择潜在的高质量上下文。在多个数据集上的实验结果表明,SMART显著提升了问答性能,并超越了以往的无监督上下文选择方法,为RAG展示了一种有前景的策略。

英文摘要:

Retrieval-Augmented Generation (RAG) has greatly improved large language models (LLMs) by enabling them to generate accurate, contextually grounded responses through the integration of external information. However, conventional RAG approaches, which prioritize top-ranked documents based solely on query-context relevance, often introduce redundancy and conflicting information. This issue is particularly evident in unsupervised retrieval settings, where there are no mechanisms to effectively mitigate these problems, leading to suboptimal context selection. To address this, we propose Selection using Matrices for Augmented Retrieval (SMART) in question answering tasks, a fully unsupervised and training-free framework designed to optimize context selection in RAG. SMART leverages Determinantal Point Processes (DPPs) to simultaneously model relevance, diversity and conflict, ensuring the selection of potentially high-quality contexts. Experimental results across multiple datasets demonstrate that SMART significantly enhances QA performance and surpasses previous unsupervised context selection methods, showing a promising strategy for RAG.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑