arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2402.01767cs.CLcs.AIcs.LG
收藏

HiQA:一种用于多文档问答的分层上下文增强检索与生成模型

HiQA: A Hierarchical Contextual Augmentation RAG for Multi-Documents QA

Nanjing University of Aeronautics and Astronautics(南京航空航天大学);Southeast University(东南大学);Hello World(Shanghai) Technology Co., Ltd.(Hello World(上海)科技有限公司)

Xinyue Chen, Pengyu Gao, Jiangjiang Song, Xinjian Chen, Xiaoyang Tan

AI总结:

针对检索增强生成在多文档问答中面对大量相似文档时检索准确性有限的问题,提出HiQA框架,它集成级联元数据与多路径检索机制,还发布MasQA基准,在多文档环境中展现了最优性能。

摘要:

检索增强生成(RAG)迅速推动了语言模型领域发展,尤其在问答系统中。通过在响应生成阶段整合外部文档,RAG显著提高了语言模型的准确性和可靠性,提升了回答质量并减少幻觉。但面对大量难以区分的文档时,检索准确性有限。为此提出HiQA,这是一个将级联元数据集成到内容中的先进多文档问答框架及多路径检索机制。还发布了MasQA基准进行评估研究。最后,HiQA在多文档环境中展现了最优性能。

英文摘要:

Retrieval-Augmented Generation (RAG) significantly improves document-based question answering by integrating external documents during generation. However, retrieval accuracy can degrade when the knowledge base contains many semantically and structurally similar documents. We introduce HiQA, a practical hierarchical contextual augmentation framework for multi-document question answering (MDQA). HiQA enriches text chunks with cascading document metadata, such as document titles and section paths, so that retrieval can use both local content and document structure. The framework also uses a multi-route retriever that combines semantic, lexical, and keyword/entity signals. We further introduce MasQA, a benchmark designed to evaluate MDQA systems in realistic similar-document settings. Experiments show that HiQA improves retrieval and answer quality on MasQA and remains competitive on public MDQA benchmarks, while its benefits are strongest for structured, domain-specific, highly similar document collections.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑