本文聚焦于减小问答系统所需提示上下文规模并提升其质量的方法。试图通过增加检索到的分块文档数量来扩大与查询相关的上下文，可能显著增加处理复杂度，并降低 Large Language Model（LLM，大语言模型）在生成查询响应时的性能。众所周知，为响应查询而从数据库检索到的大量文档可能包含无关信息，这往往会导致最终答案出现幻觉。我们的目标是选择语义最相关的文档，并将被舍弃的文档视为离群点。我们提出并评估了多种识别离群点的方法，其通过构造特征来利用从向量数据库检索得到的嵌入向量到质心向量和查询向量的距离。实验通过比较检索增强后 LLM 响应与使用 OpenAI GPT-4o 模型获得的真实答案之间的相似度来评估这些方法。结果发现，随着问题和答案复杂度的增加，所取得的改进最为显著。
英文摘要：
In this paper, we focus on methods to reduce the size and improve the quality of the prompt context required for question-answering systems. Attempts to increase the number of retrieved chunked documents and thereby enlarge the context related to the query can significantly complicate the processing and decrease the performance of a Large Language Model (LLM) when generating responses to queries. It is well known that a large set of documents retrieved from a database in response to a query may contain irrelevant information, which often leads to hallucinations in the resulting answers. Our goal is to select the most semantically relevant documents, treating the discarded ones as outliers. We propose and evaluate several methods for identifying outliers by creating features that utilize the distances of embedding vectors, retrieved from the vector database, to both the centroid and the query vectors. The methods were evaluated by comparing the similarities of the retrieved LLM responses to ground-truth answers obtained using the OpenAI GPT-4o model. It was found that the greatest improvements were achieved with increasing complexity of the questions and answers.
A Systematic Study of Retrieval Pipeline Design for Retrieval-Augmented Medical Question Answering
Department of Mechatronics & Industrial Engineering, Chittagong University of Engineering & Technology（吉大港工程与技术大学机电与工业工程系）；Department of Mechanical Engineering, Chittagong University of Engineering & Technology（吉大港工程与技术大学机械工程系）
R^2AG: Incorporating Retrieval Information into Retrieval Augmented Generation
School of Computer Science, South China Normal University（华南师范大学计算机学院）；The Hong Kong University of Science and Technology (Guangzhou)（香港科技大学（广州））；The Hong Kong University of Science and Technology（香港科技大学）
MODE-RAG: Manifold Outlier Diagnosis and Energy-based Retrieval-Augmented Generation Evaluation
School of Computer Science & Tech, Huazhong University of Science and Technology（华中科技大学计算机科学与技术学院）；School of AI and Automation, Huazhong University of Science and Technology（华中科技大学人工智能与自动化学院）
LevelRAG: Enhancing Retrieval-Augmented Generation with Multi-hop Logic Planning over Rewriting Augmented Searchers
Institute of Computing Technology, Chinese Academy of Sciences（中国科学院计算技术研究所）；Chinese Academy of Sciences（中国科学院）；University of Chinese Academy of Sciences（中国科学院大学）；Harbin Institute of Technology (Shenzhen)（哈尔滨工业大学（深圳））
A Large Language Model-based Framework for Semi-Structured Tender Document Retrieval-Augmented Generation
School of Information Management Sun Yat-sen University Guangzhou, China；School of Information Management Sun Yat-sen University Guangzhou, China corresponding author
Beyond the Parameters: A Technical Survey of Contextual Enrichment in Large Language Models: From In-Context Prompting to Causal Retrieval-Augmented Generation
Retrieval-Augmented Large Language Models for Evidence-Informed Guidance on Cannabidiol Use in Older Adults
Lawrence Bloomberg Faculty of Nursing, University of Toronto（多伦多大学劳伦斯·布隆伯格护理学院）；KITE Research Institute, Toronto Rehabilitation Institute, University Health Network（大学健康网络多伦多康复研究所KITE研究所）；College of Engineering and Technology, American University of the Middle East（中东美国大学工程与技术学院）
CausalRAG: Integrating Causal Graphs into Retrieval-Augmented Generation
Department of Computer and Data Sciences, Case Western Reserve University（计算机与数据科学系，凯斯西储大学）；Department of Design and Innovation, Case Western Reserve University（设计与创新系，凯斯西储大学）
Improving Context Fidelity via Native Retrieval-Augmented Reasoning
DIRO, Université de Montréal（蒙特利尔大学计算机科学与运筹学系）；MetaGPT；Mila - Quebec AI Institute（米拉-魁北克人工智能研究所）；McGill University（麦吉尔大学）；Yale University（耶鲁大学）；Canada CIFAR AI Chair（加拿大CIFAR人工智能教席）
