arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2412.05547cs.IRcs.AI

KG-Retriever:面向检索增强大语言模型的高效知识索引

KG-Retriever: Efficient Knowledge Indexing for Retrieval-Augmented Large Language Models

Beijing University of Posts and Telecommunications(北京邮电大学);University of Science and Technology Beijing(北京科技大学);Xiaomi Corporation(小米公司)

Weijie Chen, Ting Bai, Jinbo Su, Jian Luan, Wei Liu, Chuan Shi

AI总结:

本文提出KG-Retriever框架,通过知识图谱层与协作文档层构成的分层索引图增强文档连通性,缓解多跳问答中的信息碎片化问题,并在五个QA数据集上验证了其检索效果与效率。

摘要:

具有检索增强生成的大语言模型在复杂检索任务中面临关键挑战,例如多跳问答,这要求模型跨多个文档进行导航,并基于碎片化信息生成全面回答。为应对这一挑战,我们提出了一种新颖的基于知识图谱的RAG框架,并配备分层知识检索器,称为KG-Retriever。KG-Retriever中的检索索引构建在一个分层索引图上,该图由知识图谱层和协作文档层组成。图结构的关联特性被充分利用,以增强文档内和文档间的连通性,从而从根本上缓解信息碎片化问题,同时提高大语言模型跨文档检索的效率。借助来自相邻文档的粗粒度协作信息以及来自知识图谱的简洁信息,KG-Retriever在五个公开问答数据集上取得了显著改进,展示了我们所提出的RAG框架的有效性和高效性。

英文摘要:

Large language models with retrieval-augmented generation encounter a pivotal challenge in intricate retrieval tasks, e.g., multi-hop question answering, which requires the model to navigate across multiple documents and generate comprehensive responses based on fragmented information. To tackle this challenge, we introduce a novel Knowledge Graph-based RAG framework with a hierarchical knowledge retriever, termed KG-Retriever. The retrieval indexing in KG-Retriever is constructed on a hierarchical index graph that consists of a knowledge graph layer and a collaborative document layer. The associative nature of graph structures is fully utilized to strengthen intra-document and inter-document connectivity, thereby fundamentally alleviating the information fragmentation problem and meanwhile improving the retrieval efficiency in cross-document retrieval of LLMs. With the coarse-grained collaborative information from neighboring documents and concise information from the knowledge graph, KG-Retriever achieves marked improvements on five public QA datasets, showing the effectiveness and efficiency of our proposed RAG framework.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑