ARAGOG：先进的RAG输出分级
ARAGOG: Advanced RAG Output Grading
AI总结：
本研究通过实验对比多种RAG方法，发现HyDE、LLM重排序和句子窗口检索能显著提升检索精度，而MMR、Cohere rerank及多查询方法优势有限，并公开了ARAGOG资源库。
摘要：
检索增强生成（RAG）对于将外部知识整合到大语言模型（LLM）输出中至关重要。虽然关于RAG的文献正在增长，但主要集中于系统性综述以及新的最先进（SoTA）技术与其前身的比较，缺乏广泛的实验对比。本研究通过评估各种RAG方法对检索精度和答案相似度的影响，开始填补这一空白。我们发现，假设文档嵌入（HyDE）和LLM重排序显著提高了检索精度。然而，最大边际相关性（MMR）和Cohere rerank相比基线朴素RAG系统并未表现出显著优势，多查询方法表现不佳。句子窗口检索在检索精度上最为有效，尽管其在答案相似度上的表现不稳定。研究证实了文档摘要索引作为一种有效的检索方法的潜力。所有与本研究所相关的资源均可通过我们的GitHub仓库ARAGOG（https://github.com/predlico/ARAGOG）公开获取，以供进一步研究。我们欢迎社区继续推进这项关于RAG系统的探索性研究。
英文摘要：
Retrieval-Augmented Generation (RAG) is essential for integrating external knowledge into Large Language Model (LLM) outputs. While the literature on RAG is growing, it primarily focuses on systematic reviews and comparisons of new state-of-the-art (SoTA) techniques against their predecessors, with a gap in extensive experimental comparisons. This study begins to address this gap by assessing various RAG methods' impacts on retrieval precision and answer similarity. We found that Hypothetical Document Embedding (HyDE) and LLM reranking significantly enhance retrieval precision. However, Maximal Marginal Relevance (MMR) and Cohere rerank did not exhibit notable advantages over a baseline Naive RAG system, and Multi-query approaches underperformed. Sentence Window Retrieval emerged as the most effective for retrieval precision, despite its variable performance on answer similarity. The study confirms the potential of the Document Summary Index as a competent retrieval approach. All resources related to this research are publicly accessible for further investigation through our GitHub repository ARAGOG (https://github.com/predlico/ARAGOG). We welcome the community to further this exploratory study in RAG systems.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
