arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2410.05779cs.IRcs.AI
收藏

LightRAG:简单且快速的检索增强生成

LightRAG: Simple and Fast Retrieval-Augmented Generation

Beijing University of Posts and Telecommunications(北京邮电大学);University of Hong Kong(香港大学)

Zirui Guo, Lianghao Xia, Yanhua Yu, Tu Ao, Chao Huang

AI总结:

本文提出 LightRAG 框架,通过将图结构引入文本索引与检索,采用双层检索系统和增量更新算法,解决了现有 RAG 系统数据表示扁平化和上下文感知不足的问题,显著提升了检索准确性与效率。

摘要:

检索增强生成(RAG)系统通过整合外部知识源来增强大型语言模型(LLM),从而能够提供更准确且符合上下文相关的响应以满足用户需求。然而,现有的 RAG 系统存在显著局限性,包括依赖扁平化的数据表示和上下文感知能力不足,这可能导致生成的答案碎片化,无法捕捉复杂的相互依赖关系。为了应对这些挑战,我们提出了 LightRAG,它将图结构引入文本索引和检索过程中。这一创新框架采用双层检索系统,增强了从低级和高级知识发现中进行全面信息检索的能力。此外,图结构与向量表示的结合促进了对相关实体及其关系的高效检索,在保持上下文相关性的同时显著缩短了响应时间。增量更新算法进一步增强了这一能力,该算法确保了新数据的及时整合,使系统能够在快速变化的数据环境中保持有效性和响应能力。广泛的实验验证表明,与现有方法相比,检索准确性和效率均有显著提升。我们已将 LightRAG 开源,访问链接为:https://github.com/HKUDS/LightRAG

英文摘要:

Retrieval-Augmented Generation (RAG) systems enhance large language models (LLMs) by integrating external knowledge sources, enabling more accurate and contextually relevant responses tailored to user needs. However, existing RAG systems have significant limitations, including reliance on flat data representations and inadequate contextual awareness, which can lead to fragmented answers that fail to capture complex inter-dependencies. To address these challenges, we propose LightRAG, which incorporates graph structures into text indexing and retrieval processes. This innovative framework employs a dual-level retrieval system that enhances comprehensive information retrieval from both low-level and high-level knowledge discovery. Additionally, the integration of graph structures with vector representations facilitates efficient retrieval of related entities and their relationships, significantly improving response times while maintaining contextual relevance. This capability is further enhanced by an incremental update algorithm that ensures the timely integration of new data, allowing the system to remain effective and responsive in rapidly changing data environments. Extensive experimental validation demonstrates considerable improvements in retrieval accuracy and efficiency compared to existing approaches. We have made our LightRAG open-source and available at the link: https://github.com/HKUDS/LightRAG

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑