arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2502.01142cs.AIcs.CLcs.IR

DeepRAG:面向大语言模型的逐步思考检索

DeepRAG: Thinking to Retrieve Step by Step for Large Language Models

Chinese Information Processing Laboratory, Institute of Software, Chinese Academy of Sciences(中国科学院软件研究所信息处理实验室);University of Chinese Academy of Sciences(中国科学院大学);Pattern Recognition Center, WeChat AI, Tencent Inc, China(腾讯人工智能部模式识别中心)

Xinyan Guan, Jiali Zeng, Fandong Meng, Chunlei Xin, Yaojie Lu, Hongyu Lin, Xianpei Han, Le Sun, Jie Zhou

AI总结:

针对RAG中任务分解失效与冗余检索问题,本文提出DeepRAG,将检索增强推理建模为MDP并逐步自适应决定是否检索,实验显示其提升效率且准确率提高26.4%。

摘要:

大语言模型(LLM)已展现出显著的推理能力,但其参数化知识在时效性、准确性和全面性方面的局限导致严重的事实幻觉,从而限制了实际应用。同时,由于任务分解无效和检索冗余,利用推理增强检索增强生成(RAG)仍具挑战,这些问题会引入噪声并降低回答质量。本文提出 DeepRAG 框架,将检索增强推理建模为马尔可夫决策过程(MDP),以实现合理且自适应的检索。通过迭代分解查询,DeepRAG 在每一步动态决定是检索外部知识还是依赖参数化推理。实验表明,DeepRAG 提升了检索效率,并将回答准确率提高 26.4%,证明了其在增强检索增强推理方面的有效性。

英文摘要:

Large Language Models (LLMs) have shown remarkable reasoning capabilities, while their practical applications are limited by severe factual hallucinations due to limitations in the timeliness, accuracy, and comprehensiveness of their parametric knowledge. Meanwhile, enhancing retrieval-augmented generation (RAG) with reasoning remains challenging due to ineffective task decomposition and redundant retrieval, which can introduce noise and degrade response quality. In this paper, we propose DeepRAG, a framework that models retrieval-augmented reasoning as a Markov Decision Process (MDP), enabling reasonable and adaptive retrieval. By iteratively decomposing queries, DeepRAG dynamically determines whether to retrieve external knowledge or rely on parametric reasoning at each step. Experiments show that DeepRAG improves retrieval efficiency and boosts answer accuracy by 26.4%, demonstrating its effectiveness in enhancing retrieval-augmented reasoning.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑