arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2501.05475cs.CLcs.AIcs.IR
收藏

通过 LLM 中证据回溯实现的检索增强生成

Retrieval-Augmented Generation by Evidence Retroactivity in LLMs

Xiaomi Corporation(小米公司)

Liang Xiao, Wen Dai, Shuai Chen, Bin Qin, Chongyang Shi, Haopeng Jing, Tianyu Guo

AI总结:

针对单向检索增强推理中错误不可逆的问题,提出 RetroRAG 框架,通过证据整理、发现与回溯更新迭代修正推理链,并显著提升多跳问答性能。

摘要:

检索增强生成因其能够整合相关外部知识、提高 LLM 回答的准确性和可靠性而受到广泛关注。现有大多数方法采用动态的多次检索—生成流程,通过将复杂的多跳问题分解为子问题来加以解决。然而,这些方法依赖单向的前向推理范式:由不充分的推理步骤或当前检索系统固有缺陷导致的错误是不可逆的,可能使整个推理链偏离方向。本工作首次提出 Retroactive Retrieval-Augmented Generation(RetroRAG,回溯式检索增强生成),这是一种用于构建回溯式推理范式的新颖框架。RetroRAG 会修订并更新证据,将推理链重新引导至正确方向。该框架构建了一个证据整理—发现框架,用于搜索、生成并精炼可信证据。它从已有源知识中综合出与问题中关键实体相关的推断性证据,并制定搜索查询以发掘额外信息。随着新证据被发现,RetroRAG 会持续更新并组织这些信息,增强其定位进一步必要证据的能力。配合一个用于生成并评估输出的 Answerer,RetroRAG 能够迭代式地精炼其推理过程,直至获得可靠答案。实证评估表明,RetroRAG 显著优于现有方法。

英文摘要:

Retrieval-augmented generation has gained significant attention due to its ability to integrate relevant external knowledge, enhancing the accuracy and reliability of the LLMs' responses. Most of the existing methods apply a dynamic multiple retrieval-generating process, to address multi-hop complex questions by decomposing them into sub-problems. However, these methods rely on an unidirectional forward reasoning paradigm, where errors from insufficient reasoning steps or inherent flaws in current retrieval systems are irreversible, potentially derailing the entire reasoning chain. For the first time, this work introduces Retroactive Retrieval-Augmented Generation (RetroRAG), a novel framework to build a retroactive reasoning paradigm. RetroRAG revises and updates the evidence, redirecting the reasoning chain to the correct direction. RetroRAG constructs an evidence-collation-discovery framework to search, generate, and refine credible evidence. It synthesizes inferential evidence related to the key entities in the question from the existing source knowledge and formulates search queries to uncover additional information. As new evidence is found, RetroRAG continually updates and organizes this information, enhancing its ability to locate further necessary evidence. Paired with an Answerer to generate and evaluate outputs, RetroRAG is capable of refining its reasoning process iteratively until a reliable answer is obtained. Empirical evaluations show that RetroRAG significantly outperforms existing methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑