你知道你在谈论什么吗?刻画查询-知识相关性以实现可靠的检索增强生成
Do You Know What You Are Talking About? Characterizing Query-Knowledge Relevance For Reliable Retrieval Augmented Generation
AI总结:
本文提出一种统计框架,通过在线GoF测试检测超出知识范围的查询及离线检测查询分布偏移,以评估查询-知识相关性,从而提升RAG系统的可靠性。
摘要:
语言模型(LMs)已知会产生幻觉和错误信息。检索增强生成(RAG)从外部知识语料库中检索可验证的信息,以补充LMs中的参数化知识,为这些问题提供了切实的解决方案。然而,RAG的生成质量高度依赖于用户查询与检索到的文档之间的相关性。当查询超出了外部知识语料库所表示的知识范围,或者语料库中的信息已过时,可能会生成不准确的回复。在这项工作中,我们建立了一个统计框架,通过捕获知识相关性来评估RAG系统能多好地回答一个查询。我们引入了一种在线测试程序,采用拟合优度检验来检查每个用户查询的相关性,以检测知识相关性低的超出知识范围的查询。此外,我们开发了一种离线测试框架,用于检查一批用户查询,旨在检测查询分布中的显著偏移,这表明知识语料库已不再能够充分支持用户的兴趣。我们通过对八个问答(QA)数据集的系统评估展示了这些策略的能力,结果表明新的测试框架是增强现有RAG系统可靠性的有效解决方案。
英文摘要:
Language models (LMs) are known to suffer from hallucinations and misinformation. Retrieval augmented generation (RAG) that retrieves verifiable information from an external knowledge corpus to complement the parametric knowledge in LMs provides a tangible solution to these problems. However, the generation quality of RAG is highly dependent on the relevance between a user's query and the retrieved documents. Inaccurate responses may be generated when the query is outside of the scope of knowledge represented in the external knowledge corpus or if the information in the corpus is out-of-date. In this work, we establish a statistical framework that assesses how well a query can be answered by an RAG system by capturing the relevance of knowledge. We introduce an online testing procedure that employs goodness-of-fit (GoF) tests to inspect the relevance of each user query to detect out-of-knowledge queries with low knowledge relevance. Additionally, we develop an offline testing framework that examines a collection of user queries, aiming to detect significant shifts in the query distribution which indicates the knowledge corpus is no longer sufficiently capable of supporting the interests of the users. We demonstrate the capabilities of these strategies through a systematic evaluation on eight question-answering (QA) datasets, the results of which indicate that the new testing framework is an efficient solution to enhance the reliability of existing RAG systems.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。