arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2503.08398cs.CLcs.IR

OpenRAG:通过上下文检索学习端到端优化检索增强生成

OpenRAG: Optimizing RAG End-to-End via In-Context Retrieval Learning

Hong Kong University of Science and Technology(香港科技大学)

Jiawei Zhou, Lei Chen

AI总结:

本文提出 OpenRAG 框架,通过端到端调优检索器以捕捉上下文相关性,在多个任务上较原始检索器提升 4.0%、优于现有最优检索器 2.1%,并展示小模型端到端调优可超越 8B 大模型,体现高成本效益。

摘要:

在本文中,我们分析并通过实验表明,传统信息检索(IR)场景中学习到的相关性在检索增强生成(RAG)场景下可能并不一致。为弥合这一差距,我们提出 OpenRAG,一个通过调优检索器以捕捉上下文相关性从而实现端到端优化的 RAG 框架,使其能够适应多样且不断变化的需求。在广泛任务上的大量实验表明,OpenRAG 通过端到端调优检索器,相较原始检索器实现了 4.0% 的一致提升,并持续优于现有最优检索器 2.1%。此外,我们的结果表明,在某些任务上,端到端调优的 0.2B 检索器所取得的提升可超过面向 RAG 或经指令调优的 8B 大语言模型(LLMs),凸显了我们的方法在增强 RAG 系统方面的成本效益。

英文摘要:

In this paper, we analyze and empirically show that the learned relevance for conventional information retrieval (IR) scenarios may be inconsistent in retrieval-augmented generation (RAG) scenarios. To bridge this gap, we introduce OpenRAG, a RAG framework that is optimized end-to-end by tuning the retriever to capture in-context relevance, enabling adaptation to the diverse and evolving needs. Extensive experiments across a wide range of tasks demonstrate that OpenRAG, by tuning a retriever end-to-end, leads to a consistent improvement of 4.0% over the original retriever, consistently outperforming existing state-of-the-art retrievers by 2.1%. Additionally, our results indicate that for some tasks, an end-to-end tuned 0.2B retriever can achieve improvements that surpass those of RAG-oriented or instruction-tuned 8B large language models (LLMs), highlighting the cost-effectiveness of our approach in enhancing RAG systems.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑