C-3PO: Compact Plug-and-Play Proxy Optimization to Achieve Human-like Retrieval-Augmented Generation
Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学人工智能学院);Tongyi Lab(通义实验室);Soochow University(苏州大学);University of Oxford(牛津大学);Tsinghua University(清华大学)
Guoxin Chen, Minpeng Liao, Peiying Yu, Dingmin Wang, Zile Qiao, Chao Yang, Xin Zhao, Kai Fan
Retrieval-augmented generation (RAG) systems face a fundamental challenge in aligning independently developed retrievers and large language models (LLMs). Existing approaches typically involve modifying either component or introducing simple intermediate modules, resulting in practical limitations and sub-optimal performance. Inspired by human search behavior -- typically involving a back-and-forth process of proposing search queries and reviewing documents, we propose C-3PO, a proxy-centric framework that facilitates communication between retrievers and LLMs through a lightweight multi-agent system. Our framework implements three specialized agents that collaboratively optimize the entire RAG pipeline without altering the retriever and LLMs. These agents work together to assess the need for retrieval, generate effective queries, and select information suitable for the LLMs. To enable effective multi-agent coordination, we develop a tree-structured rollout approach for reward credit assignment in reinforcement learning. Extensive experiments in both in-domain and out-of-distribution scenarios demonstrate that C-3PO significantly enhances RAG performance while maintaining plug-and-play flexibility and superior generalization capabilities.
Memory Decoder: A Pretrained, Plug-and-Play Memory for Large Language Models
LUMIA Lab(LUMIA实验室);School of Artificial Intelligence(人工智能学院);Shanghai Jiao Tong University(上海交通大学);Shanghai AI Laboratory(上海人工智能实验室);Tsinghua University(清华大学);SJTU Paris Elite Institute of Technology(上海交通大学巴黎精英技术学院)
EcoSafeRAG: Efficient Security through Context Analysis in Retrieval-Augmented Generation
Institute of Information Engineering, Chinese Academy of Sciences(信息工程研究所,中国科学院);School of Cybersecurity, University of Chinese Academy of Sciences(网络安全学院,中国科学院大学);State Key Laboratory of Cyberspace Security Defense(网络空间安全防御国家重点实验室)
Model Internals-based Answer Attribution for Trustworthy Retrieval-Augmented Generation
Center for Language and Cognition (CLCG), University of Groningen(格罗宁根大学语言与认知中心(CLCG));Institute for Logic, Language and Computation (ILLC), University of Amsterdam(阿姆斯特丹大学逻辑、语言与计算研究所(ILLC))
SearchLVLMs: A Plug-and-Play Framework for Augmenting Large Vision-Language Models by Searching Up-to-Date Internet Knowledge
OpenGVLab(开放通用视觉实验室);Shanghai AI Laboratory(上海人工智能实验室);Beijing Institute of Technology(北京理工大学);Zhejiang University(浙江大学);The University of Hong Kong(香港大学)
School of Artificial Intelligence, Wuhan University(武汉大学人工智能学院);School of Computer Science, Wuhan University(武汉大学计算机学院);School of Information Management, Wuhan University(武汉大学信息管理学院);School of Computer Science, Shanghai Jiao Tong University(上海交通大学计算机学院)
FacTool: Factuality Detection in Generative AI -- A Tool Augmented Framework for Multi-Task and Multi-Domain Scenarios
Shanghai Jiao Tong University(上海交通大学);Carnegie Mellon University(卡内基梅隆大学);City University of Hong Kong(香港城市大学);New York University(纽约大学);Meta AI;The Hong Kong University of Science and Technology(香港科技大学);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室)
GUIDE: Resolving Domain Bias in GUI Agents through Real-Time Web Video Retrieval and Plug-and-Play Annotation
Shanghai Jiao Tong University(上海交通大学);State Key Laboratory for General Artificial Intelligence, BIGAI(通用人工智能国家重点实验室,北京通用人工智能研究院);Beijing Institute of Technology(北京理工大学)
Beyond Semantic Relevance: Counterfactual Risk Minimization for Robust Retrieval-Augmented Generation
National Engineering Research Center for Software Engineering, Peking University(软件工程国家工程研究中心,北京大学);City University of Hong Kong(香港城市大学);Tencent Technology(腾讯科技);Peking University(北京大学)
SkewRoute: Training-Free LLM Routing for Knowledge Graph Retrieval-Augmented Generation via Score Skewness of Retrieved Context
School of Computer Science, University of Science and Technology of China(中国科学技术大学计算机科学学院);School of Biomedical Engineering, USTC(USTC生物医学工程学院);Suzhou Institute for Advanced Reasearch, USTC(USTC苏州市先进研究所)
RAG-RewardBench: Benchmarking Reward Models in Retrieval Augmented Generation for Preference Alignment
School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所)
School of Computer Science and Technology, Harbin Institute of Technology (Shenzhen)(哈尔滨工业大学(深圳)计算机科学与技术学院);School of Computer Science, University of Sydney(悉尼大学计算机学院);Alibaba Group(阿里巴巴集团)
Retrieval-Augmented Multimodal Learning for Enzyme-Substrate Interaction Prediction Under Low-Homology Shift
School of Information Science and Engineering, East China University of Science and Technology(华东理工大学信息科学与工程学院);Institute of Natural Sciences and Zhangjiang Institute for Advanced Study, Shanghai Jiao Tong University(上海交通大学自然科学研究院和张江高等研究院);School of Life Sciences and Biotechnology, Shanghai Jiao Tong University(上海交通大学生命科学技术学院)