Tackling the Inherent Difficulty of Noise Filtering in RAG
Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学人工智能学院);Beijing Key Laboratory of Big Data Management and Analysis Methods(北京大数据管理与分析方法重点实验室);School of Software Tsinghua University(清华大学软件学院)
Retrieval-Augmented Generation (RAG) has become a widely adopted approach to enhance Large Language Models (LLMs) by incorporating external knowledge and reducing hallucinations. However, noisy or irrelevant documents are often introduced during RAG, potentially degrading performance and even causing hallucinated outputs. While various methods have been proposed to filter out such noise, we argue that identifying irrelevant information from retrieved content is inherently difficult and limited number of transformer layers can hardly solve this. Consequently, retrievers fail to filter out irrelevant documents entirely. Therefore, LLMs must be robust against such noise, but we demonstrate that standard fine-tuning approaches are often ineffective in enabling the model to selectively utilize relevant information while ignoring irrelevant content due to the structural constraints of attention patterns. To address this, we propose a novel fine-tuning method designed to enhance the model's ability to distinguish between relevant and irrelevant information within retrieved documents. Extensive experiments across multiple benchmarks show that our approach significantly improves the robustness and performance of LLMs.
Modular RAG: Transforming RAG Systems into LEGO-like Reconfigurable Frameworks
Shanghai Research Institute for Intelligent Autonomous Systems, Tongji University(同济大学上海智能自主系统研究院);College of Design and Innovation, Tongji University(同济大学设计创意学院)
LabourCrew: A Multi-Agent RAG Framework for Trustworthy Adversarial Deliberation and Statutory Reasoning over Labour Law
Ahsanullah University of Science and Technology(阿赫萨努拉科技大学);Jashore University of Science and Technology(杰肖尔科技大学);American International University - Bangladesh(美国国际大学-孟加拉)
Generating Leakage-Free Benchmarks for Robust RAG Evaluation
Department of Computer Science, Purdue University(普渡大学计算机科学系);New Jersey Institute of Technology(新泽西理工学院);University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Microsoft Research(微软研究院)
Investigating Retrieval-Augmented Generation Systems on Unanswerable, Uncheatable, Realistic, Multi-hop Queries
Yale University(耶鲁大学);University of Pennsylvania(宾夕法尼亚大学);Human Language Technology Center of Excellence(语言技术中心卓越中心);Johns Hopkins University(约翰霍普金斯大学)
CRISS: A Retrieval-Augmented AI Chatbot for Assisting Cancer Registrars
University of Missouri(密苏里大学);Missouri Cancer Registry and Research Center(密苏里癌症登记与研究中心);MU Institute for Data Science and Informatics(密苏里大学数据科学与信息学研究所)
Understand What LLM Needs: Dual Preference Alignment for Retrieval-Augmented Generation
Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学高瓴人工智能学院);School of Artificial Intelligence, Beijing University of Posts and Telecommunications(北京邮电大学人工智能学院)
UR$^2$: Unify RAG and Reasoning through Reinforcement Learning
Dept. of Comp. Sci. & Tech., Institute for AI, Tsinghua University, Beijing, China(计算机科学与技术系,人工智能研究院,清华大学,北京,中国);Institute for AI Industry Research (AIR), Tsinghua University, Beijing, China(人工智能产业研究机构(AIR),清华大学,北京,中国);School of Management Science & Information Engineering, Hebei University of Economics and Business, Hebei, China(管理科学与信息工程学院,河北经贸大学,河北,中国)
RAG-based EEG-to-Text Translation Using Deep Learning and LLMs
IAS-LAB, Department of Information Engineering, University of Padova(帕多瓦大学信息工程系IAS实验室);Padova Neuroscience Center(帕多瓦神经科学中心);Department of Health Technology, Technical University of Denmark(丹麦技术大学健康技术系)
DreamerNLplus: Interpretable Modeling of Mental Health Dynamics from Social Media Timelines using Hybrid Rule-Based and RAG Methods
Leiden Institute of Advanced Computer Science (LIACS), Leiden University(莱顿高级计算机科学研究所(LIACS),莱顿大学);School of Computing and Communications (SCC), Lancaster University(计算与通信学院(SCC),兰卡斯特大学);Department of Medical Informatics, Erasmus University Medical Center Rotterdam(医学信息学系,埃因霍温医学中心鲁特万分校);Biomedical Data Sciences, Leiden University Medical Center(生物医学数据科学,莱顿大学医学中心)
DACL-RAG: Data Augmentation Strategy with Curriculum Learning for Retrieval-Augmented Generation
School of Information Science and Technology, University of Science and Technology of China(信息科学与技术学院,中国科学技术大学);Institute of Artificial Intelligence, Hefei Comprehensive National Science Center(人工智能研究院,合肥综合性国家科学中心)
Mathematical Reasoning for Unmanned Aerial Vehicles: A RAG-Based Approach for Complex Arithmetic Reasoning
Department of Computer Science(计算机科学系);Institute For Artificial Intelligence(人工智能研究所);Hamm-Lippstadt University of Applied Sciences(哈姆-利普施塔特应用科学大学);University of Stuttgart(斯图加特大学)
Advancing Multi-Agent RAG Systems with Minimalist Reinforcement Learning
McGill University \& Mila Montréal QC Canada;The Chinese University of Hong Kong Hong Kong China;Huawei Noah’s Ark Lab Montréal QC Canada;University of Manitoba Winnipeg MB Canada;Tianjin University Tianjin China;Independent Researcher Hong Kong China;McGill University \& Mila;The Chinese University of Hong Kong;Huawei Noah’s Ark Lab;University of Manitoba;Tianjin University;Independent Researcher
CogRAG: Tackling Heterogeneous Cognitive Demands in RAG via Stratified Retrieval and Reasoning
School of Computer and Computing Science, Hangzhou City University(杭州城市大学计算机与计算科学学院);Innovation Center of Yangtze River Delta, Zhejiang University(长三角创新中心,浙江大学);Institute of Digital Twin, Eastern Institute of Technology(数字孪生研究院,东部技术研究院)
Rethinking Soft Compression in Retrieval-Augmented Generation: A Query-Conditioned Selector Perspective
Shanghai Key Laboratory of Data Science, College of Computer Science and Artificial Intelligence(上海数据科学 key 实验室,计算机科学与人工智能学院);Fudan University(复旦大学);Shanghai(上海);China(中国)
SlideCoder: Layout-aware RAG-enhanced Hierarchical Slide Generation from Design
Tsinghua University(清华大学);The Chinese University of Hong Kong(香港中文大学);Northeastern University(东北大学);Southwest University(西南大学);Kuaishou Technology(快手科技);Peng Cheng Laboratory(鹏城实验室);BNU-HKBU United International College(北京师范大学-香港 Baptist University联合国际学院);Dalian Maritime University(大连海事大学)
Personalized Education with Generative AI and Digital Twins: VR, RAG, and Zero-Shot Sentiment Analysis for Industry 4.0 Workforce Development
Department of Electrical and Computer Engineering, University of Arizona, Tucson, AZ, USA(电气与计算机工程系,亚利桑那大学,图森,亚利桑那州,美国);Department of Systems and Industrial Engineering, University of Arizona, Tucson, AZ, USA(系统与工业工程系,亚利桑那大学,图森,亚利桑那州,美国);Department of Industrial Engineering, University of Sonora, Hermosillo, Mexico(工业工程系,索诺拉大学,赫尔莫索,墨西哥)
SkewRoute: Training-Free LLM Routing for Knowledge Graph Retrieval-Augmented Generation via Score Skewness of Retrieved Context
School of Computer Science, University of Science and Technology of China(中国科学技术大学计算机科学学院);School of Biomedical Engineering, USTC(USTC生物医学工程学院);Suzhou Institute for Advanced Reasearch, USTC(USTC苏州市先进研究所)
GOSU: Retrieval-Augmented Generation with Global-Level Optimized Semantic Unit-Centric Framework
School of Future Science and Engineering, Soochow University(未来科学与工程学院,苏州大学);School of Mathematical Sciences, Soochow University(数学学院,苏州大学);School of Information Technology (Smart Campus Education Center), Suzhou Institute of Trade & Commerce(信息技术学院(智能校园教育中心),苏州贸易与商业学院)
Enhancing Speech-to-Speech Dialogue Modeling with End-to-End Retrieval-Augmented Generation
MoE Key Lab of Artificial Intelligence(人工智能增强实验室);Jiangsu Key Lab of Language Computing(江苏语言计算重点实验室);X-LANCE Lab(X-LANCE实验室);School of Computer Science, Shanghai Jiao Tong University(上海交通大学计算机科学学院);Shanghai Innovation Institute(上海创新研究院);Shanghai Aviation Electric Co., Ltd(上海航空电器有限公司)
Think Parallax: Solving Multi-Hop Problems via Multi-View Knowledge-Graph-Based Retrieval-Augmented Generation
Yangtze Delta Region Institute (Huzhou), University of Electronic Science and Technology of China(长江三角洲地区研究院(湖州),电子科学与技术大学);School of Information and Software Engineering, University of Electronic Science and Technology of China(信息与软件工程学院,电子科学与技术大学)