Large Language Models (LLMs) exhibit remarkable capabilities but are prone to generating inaccurate or hallucinatory responses. This limitation stems from their reliance on vast pretraining datasets, making them susceptible to errors in unseen scenarios. To tackle these challenges, Retrieval-Augmented Generation (RAG) addresses this by incorporating external, relevant documents into the response generation process, thus leveraging non-parametric knowledge alongside LLMs' in-context learning abilities. However, existing RAG implementations primarily focus on initial input for context retrieval, overlooking the nuances of ambiguous or complex queries that necessitate further clarification or decomposition for accurate responses. To this end, we propose learning to Refine Query for Retrieval Augmented Generation (RQ-RAG) in this paper, endeavoring to enhance the model by equipping it with capabilities for explicit rewriting, decomposition, and disambiguation. Our experimental results indicate that our method, when applied to a 7B Llama2 model, surpasses the previous state-of-the-art (SOTA) by an average of 1.9\% across three single-hop QA datasets, and also demonstrates enhanced performance in handling complex, multi-hop QA datasets. Our code is available at https://github.com/chanchimin/RQ-RAG.
KARE-RAG: Knowledge-Aware Refinement and Enhancement for RAG
School of Biomedical Engineering, Tsinghua, China(清华大学生物医学工程学院);School of Informatics, Xiamen University, China(厦门大学信息学院);Department of Computer Science and Technology, Institute for AI, Tsinghua University, China(清华大学计算机科学与技术系);Dept. of Computer Science and Technology, Northeastern University, Shenyang, China(东北大学沈阳校区计算机科学与技术系);Institute of Information Engineering, Chinese Academy of Sciences, Beijing, China(中国科学院信息工程研究所)
R$^{2}$Adapter: A Routing and Rewriting Adapter for Efficient Hybrid RAG
State Key Laboratory of AI Safety(人工智能安全国家重点实验室);Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);University of Chinese Academy of Sciences(中国科学院大学);Meituan(美团)
Investigating Retrieval-Augmented Generation Systems on Unanswerable, Uncheatable, Realistic, Multi-hop Queries
Yale University(耶鲁大学);University of Pennsylvania(宾夕法尼亚大学);Human Language Technology Center of Excellence(语言技术中心卓越中心);Johns Hopkins University(约翰霍普金斯大学)
Multi-Head RAG: Solving Multi-Aspect Problems with LLMs
Department of Computer Science, ETH Zurich(苏黎世联邦理工学院计算机科学系);IDEAS Research Institute(IDEAS研究 institute);NASK National Research Institute(国家研究 institute)
A Navigational Approach for Comprehensive RAG via Traversal over Proposition Graphs
Idiap Research Institute(日内瓦研究所);École Polytechnique Fédérale de Lausanne(联邦理工学院洛桑分校);University of Manchester(曼彻斯特大学);CRUK Manchester Institute(CRUK曼彻斯特研究所)
Optimizing Multi-Hop Document Retrieval Through Intermediate Representations
School of Software, BNRist, Tsinghua University(软件学院、BNRist、清华大学);Beijing Key Laboratory of Industrial Bigdata System and Application(北京工业大数据系统与应用重点实验室);Gaoling School of Artificial Intelligence, Renmin University of China(甘露人工智能学院、中国人民大学)
FAIR-RAG: Faithful Adaptive Iterative Refinement for Retrieval-Augmented Generation
Sharif University of Technology(谢里夫理工大学);Iran University of Science and Technology(伊朗科学技术大学);Noor Avaran Jelvehaye Maanaei Najm Co., Ltd.(诺尔·阿瓦兰·杰拉维耶·马纳埃尼纳姆公司)
Improving Retrieval-Augmented Generation in Medicine with Iterative Follow-up Questions
University of Virginia(弗吉尼亚大学);National Library of Medicine(美国国家医学图书馆);National Institutes of Health(美国国立卫生研究院);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)