arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2408.05141cs.CLcs.IR
收藏

面向复杂推理的全面增强混合RAG系统

A Hybrid RAG System with Comprehensive Enhancement on Complex Reasoning

Peking University(北京大学)

Ye Yuan, Chengwu Liu, Jingyang Yuan, Gongbo Sun, Siqi Li, Ming Zhang

AI总结:

本文提出一个混合RAG系统,通过优化文本块与表格、属性预测器、知识提取器和知识图谱提取器及推理策略,在CRAG竞赛中显著提升复杂推理准确率并降低错误率。

摘要:

检索增强生成(RAG)是一种框架,使大型语言模型(LLMs)能够通过整合外部知识库来提高准确性并减少幻觉。在本文中,我们介绍了一个混合RAG系统,该系统通过一套全面的优化措施得到增强,显著提升了检索质量、增强了推理能力,并改进了数值计算能力。我们精化了网页中的文本块和表格,添加了属性预测器以减少幻觉,实施了LLM知识提取器和知识图谱提取器,并最终构建了一种包含所有参考文献的推理策略。我们在CRAG数据集上通过Meta CRAG KDD Cup 2024竞赛对我们的系统进行了评估。本地评估和在线评估均表明,我们的系统显著增强了复杂推理能力。在本地评估中,与基线模型相比,我们显著提高了准确性并降低了错误率,取得了分数的显著提升。同时,我们在在线评估中也取得了出色的结果,展示了所提出系统的性能和泛化能力。我们系统的源代码发布在\url{https://gitlab.aicrowd.com/shizueyy/crag-new}。

英文摘要:

Retrieval-augmented generation (RAG) is a framework enabling large language models (LLMs) to enhance their accuracy and reduce hallucinations by integrating external knowledge bases. In this paper, we introduce a hybrid RAG system enhanced through a comprehensive suite of optimizations that significantly improve retrieval quality, augment reasoning capabilities, and refine numerical computation ability. We refined the text chunks and tables in web pages, added attribute predictors to reduce hallucinations, conducted LLM Knowledge Extractor and Knowledge Graph Extractor, and finally built a reasoning strategy with all the references. We evaluated our system on the CRAG dataset through the Meta CRAG KDD Cup 2024 Competition. Both the local and online evaluations demonstrate that our system significantly enhances complex reasoning capabilities. In local evaluations, we have significantly improved accuracy and reduced error rates compared to the baseline model, achieving a notable increase in scores. In the meanwhile, we have attained outstanding results in online assessments, demonstrating the performance and generalization capabilities of the proposed system. The source code for our system is released in \url{https://gitlab.aicrowd.com/shizueyy/crag-new}.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑