arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2512.20144cs.CL
收藏

通过早期知识对齐实现多跳推理

Multi-hop Reasoning via Early Knowledge Alignment

Computer Science, Fudan University(复旦大学计算机科学系);Institute of Modern Languages and Linguistics, Fudan University(复旦大学现代语言与语言学研究所);Shanghai SII(上海SII)

Yuxin Wang, Shicheng Fang, Bo Wang, Qi Luo, Xuanjing Huang, Yining Zheng, Xipeng Qiu

AI总结:

EKA通过早期知识对齐提升多跳推理效率,增强检索精度和系统性能。

摘要:

检索增强生成(RAG)已成为大型语言模型(LLMs)处理需要领域特定或最新信息的知识密集型查询的强大范式。为处理单步检索难以处理的复杂多跳问题,已提出结合强化学习的迭代RAG方法。然而,现有迭代RAG系统通常在规划时分解问题而不利用可用检索语料库的信息,导致检索和推理链条效率低下,最终性能不佳。在本文中,我们引入了早期知识对齐(EKA),这是一个简单的但有效的模块,它在迭代RAG系统中在规划之前将LLMs与检索集对齐,利用上下文相关的检索知识。在六个标准RAG数据集上的广泛实验表明,通过建立更强的推理基础,EKA显著提高了检索精度,减少了级联错误,并增强了性能和效率。从熵的角度分析表明,纳入早期知识可减少推理过程中的不必要的探索,使模型更有效地聚焦于相关的信息子集。此外,EKA证明了作为一种通用的、无需训练的推理策略,能够无缝扩展到大模型。在多样化的数据集和检索语料库上的泛化测试证实了我们方法的鲁棒性。总体而言,EKA在迭代RAG系统中推进了最先进的水平,同时揭示了结构化推理与强化学习增强框架中高效探索之间的关键相互作用。代码已发布在GitHub上。

英文摘要:

Retrieval-Augmented Generation (RAG) has emerged as a powerful paradigm for Large Language Models (LLMs) to address knowledge-intensive queries requiring domain-specific or up-to-date information. To handle complex multi-hop questions that are challenging for single-step retrieval, iterative RAG approaches incorporating reinforcement learning have been proposed. However, existing iterative RAG systems typically plan to decompose questions without leveraging information about the available retrieval corpus, leading to inefficient retrieval and reasoning chains that cascade into suboptimal performance. In this paper, we introduce Early Knowledge Alignment (EKA), a simple but effective module that aligns LLMs with retrieval set before planning in iterative RAG systems with contextually relevant retrieved knowledge. Extensive experiments on six standard RAG datasets demonstrate that by establishing a stronger reasoning foundation, EKA significantly improves retrieval precision, reduces cascading errors, and enhances both performance and efficiency. Our analysis from an entropy perspective demonstrate that incorporating early knowledge reduces unnecessary exploration during the reasoning process, enabling the model to focus more effectively on relevant information subsets. Moreover, EKA proves effective as a versatile, training-free inference strategy that scales seamlessly to large models. Generalization tests across diverse datasets and retrieval corpora confirm the robustness of our approach. Overall, EKA advances the state-of-the-art in iterative RAG systems while illuminating the critical interplay between structured reasoning and efficient exploration in reinforcement learning-augmented frameworks. The code is released at \href{https://github.com/yxzwang/EarlyKnowledgeAlignment}{Github}.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑