ChunkRAG：用于RAG系统的新型LLM分块过滤方法
ChunkRAG: Novel LLM-Chunk Filtering Method for RAG Systems
AI总结：
ChunkRAG提出LLM驱动的分块级过滤方法，通过语义分块和相关性评分减少幻觉，提升RAG系统在精确检索任务中的准确性。
摘要：
使用大型语言模型（LLM）的检索增强生成（RAG）系统，由于检索到不相关或松散相关的信息，常常生成不准确的响应。现有方法在文档级别操作，无法有效过滤此类内容。我们提出了LLM驱动的分块过滤方法ChunkRAG，这是一个通过在分块级别评估和过滤检索信息来增强RAG系统的框架。我们的方法采用语义分块将文档划分为连贯的段落，并利用基于LLM的相关性评分来评估每个分块与用户查询的一致性。通过在生成阶段之前过滤掉不太相关的分块，我们显著减少了幻觉并提高了事实准确性。实验表明，我们的方法优于现有的RAG模型，在需要精确信息检索的任务上实现了更高的准确性。这一进步增强了RAG系统的可靠性，使其对事实核查和多跳推理等应用特别有益。
英文摘要：
Retrieval-Augmented Generation (RAG) systems using large language models (LLMs) often generate inaccurate responses due to the retrieval of irrelevant or loosely related information. Existing methods, which operate at the document level, fail to effectively filter out such content. We propose LLM-driven chunk filtering, ChunkRAG, a framework that enhances RAG systems by evaluating and filtering retrieved information at the chunk level. Our approach employs semantic chunking to divide documents into coherent sections and utilizes LLM-based relevance scoring to assess each chunk's alignment with the user's query. By filtering out less pertinent chunks before the generation phase, we significantly reduce hallucinations and improve factual accuracy. Experiments show that our method outperforms existing RAG models, achieving higher accuracy on tasks requiring precise information retrieval. This advancement enhances the reliability of RAG systems, making them particularly beneficial for applications like fact-checking and multi-hop reasoning.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
