RAG / 检索增强生成

Rethinking Retrieval-Augmented Generation for Medicine: A Large-Scale, Systematic Expert Evaluation and Practical Insights

Hyunjae Kim, Jiwoong Sohn, Aidan Gilson, Nicholas Cochran-Caggiano, Serina Applebaum, Heeju Jin, Seihee Park, Yujin Park, Jiyeong Park, Seoyoung Choi, Brittany Alexandra Herrera Contreras, Thomas Huang, Jaehoon Yun, Ethan F. Wei, Roy Jiang, Leah Colucci, Eric Lai, Amisha Dave, Tuo Guo, Maxwell B. Singer, Yonghoe Koo, Ron A. Adelman, James Zou, Andrew Taylor, Arman Cohan, Hua Xu, Qingyu Chen

机构 * Yale School of Medicine（耶鲁医学院） ； Yale University（耶鲁大学） ； ETH Zurich（苏黎世联邦理工学院） ； Harvard Medical School（哈佛医学院） ； Geisel School of Medicine at Dartmouth（达特茅斯大学盖塞医学院） ； Seoul National University College of Medicine（首尔国立大学医学院） ； Hanyang University College of Medicine（翰林大学医学院） ； PA Leadership Charter School（宾夕法尼亚州西切斯特市领导学校） 纠错

专题命中 RAG评测 ：retrieval-augmented generation(title,abstract)；RAG(abstract)；分类 cs.CL

Comments 34 pages, 6 figures

RAG-targeted Adversarial Attack on LLM-based Threat Detection and Mitigation Framework

Seif Ikbarieh, Kshitiz Aryal, Maanak Gupta

机构 * Department of Computer Science（计算机科学系） ； Tennessee Tech University（田纳西科技大学） ； School of Interdisciplinary Informatics（跨学科信息学学院） ； University of Nebraska Omaha（内布拉斯加大学奥马哈分校） 纠错

专题命中 RAG评测 ：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.AI

MetaRAG: Metamorphic Testing for Hallucination Detection in RAG Systems

Channdeth Sok, David Luz, Yacine Haddam

机构 * Forvia Paris Tech Center, GIT, Immeuble Lumière, 40 avenue des Terroirs de France, 75012 Paris, France（巴黎Forvia技术中心，GIT，Lumière大厦，法国巴黎75012） 纠错

专题命中 RAG评测 ：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.CL

Comments Identity-Aware AI workshop at 28th European Conference on Artificial Intelligence, October 25, 2025, Bologna, Italy

Face the Facts! Evaluating RAG-based Pipelines for Professional Fact-Checking

Daniel Russo, Stefano Menini, Jacopo Staiano, Marco Guerini

机构 * Fondazione Bruno Kessler（布罗诺·凯塞勒基金会） ； University of Trento（特伦托大学） 纠错

专题命中 RAG评测 ：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.CL

Comments Code and data at https://github.com/drusso98/face-the-facts - Accepted for publication at INLG 2025

RARE: Retrieval-Aware Robustness Evaluation for Retrieval-Augmented Generation Systems

Yixiao Zeng, Tianyu Cao, Danqing Wang, Xinran Zhao, Zimeng Qiu, Morteza Ziyadi, Tongshuang Wu, Lei Li

机构 * Carnegie Mellon University Language Technologies Institute（卡内基梅隆大学语言技术研究所） ； Amazon（亚马逊） 纠错

专题命中 RAG评测 ：retrieval-augmented generation(title,abstract)；RAG(abstract)；分类 cs.CL

Rethinking and Exploring String-Based Malware Family Classification in the Era of LLMs and RAG

Yufan Chen, Daoyuan Wu, Juantao Zhong, Zicheng Zhang, Debin Gao, Shuai Wang, Yingjiu Li, Ning Liu, Jiachi Chen, Rocky K. C. Chang

机构 * University of Oregon（俄勒冈大学） ； City University of Hong Kong（香港城市大学） ； Sun Yat-sen University（中山大学） ； Calvin University（加州学院） 纠错

专题命中 RAG评测 ：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.AI

Comments This is a technical report from Lingnan University, Hong Kong. Code is available at https://github.com/AIS2Lab/MalwareGPT

HA-RAG: Hotness-Aware RAG Acceleration via Mixed Precision and Data Placement

Danying Ge, Jianhua Gao, Yixue Yang, Weixing Ji

专题命中 RAG评测 ：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.AI

Comments 13 pages,16 figures,2 tables

ChronoPlay: A Framework for Modeling Dual Dynamics and Authenticity in Game RAG Benchmarks

Liyang He, Yuren Zhang, Ziwei Zhu, Zhenghui Li, Shiwei Tong

专题命中 RAG评测 ：RAG(title,abstract)；retrieval augmented generation(abstract)；分类 cs.CL

Repairing Tool Calls Using Post-tool Execution Reflection and RAG

Jason Tsay, Zidane Wright, Gaodan Fang, Kiran Kate, Saurabh Jha, Yara Rizk

机构 * IBM Research（IBM研究院） 纠错

专题命中 RAG评测 ：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.AI

Beating Harmful Stereotypes Through Facts: RAG-based Counter-speech Generation

Greta Damo, Elena Cabrio, Serena Villata

机构 * Université Côte d’Azur, CNRS, Inria, I3S, France（法国大学-科蒂-阿祖尔大学、国家科学研究中心、法国国家信息与自动化研究所、I3S研究所） 纠错

专题命中 RAG评测 ：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.CL

Agentic RAG for Software Testing with Hybrid Vector-Graph and Multi-Agent Orchestration

Mohanakrishnan Hariharan, Satish Arvapalli, Seshu Barma, Evangeline Sheela

专题命中 RAG评测 ：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.AI

On the Diminishing Returns of Complex Robust RAG Training in the Era of Powerful LLMs

Hanxing Ding, Shuchang Tao, Liang Pang, Zihao Wei, Liwei Chen, Kun Xu, Huawei Shen, Xueqi Cheng

机构 * State Key Laboratory of AI Safety, Institute of Computing Technology, Chinese Academy of Sciences（人工智能安全国家重点实验室，计算技术研究所，中国科学院） ； Tongyi Lab, Alibaba Group（通义实验室，阿里巴巴集团） ； Institute of Computing Technology（计算技术研究所） 纠错

专题命中 RAG评测 ：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.CL

Comments Accepted at SIGIR-AP 2025

Methodological Framework for Quantifying Semantic Test Coverage in RAG Systems

Noah Broestl, Adel Nasser Abdalla, Rajprakash Bale, Hersh Gupta, Max Struever

专题命中 RAG评测 ：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.AI

Comments 7 pages, 3 figures, 1 table, 1 algo

Human-Centered Evaluation of RAG outputs: a framework and questionnaire for human-AI collaboration

Aline Mangold, Kiran Hoffmann

机构 * Dresden University of Technology（德累斯顿技术大学） 纠错

专题命中 RAG评测 ：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.AI

Silent Leaks: Implicit Knowledge Extraction Attack on RAG Systems through Benign Queries

Yuhao Wang, Wenjie Qu, Shengfang Zhai, Yanze Jiang, Zichen Liu, Yue Liu, Yinpeng Dong, Jiaheng Zhang

机构 * National University of Singapore（新加坡国立大学） ； Peking University（北京大学） ； Tsinghua University（清华大学） 纠错

专题命中 RAG评测 ：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.AI

ScenarioBench: Trace-Grounded Compliance Evaluation for Text-to-SQL and RAG

Zahra Atf, Peter R Lewis

机构 * Faculty of Business and Information Technology（商业与信息技术学院） ； Ontario Tech University（安大略技术大学） 纠错

专题命中 RAG评测 ：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.CL

Comments Accepted for presentation at the LLMs Meet Databases (LMD) Workshop, 35th IEEE International Conference on Collaborative Advances in Software and Computing, 2025. Workshop website: https://sites.google.com/view/lmd2025/home

Design and Implementation of a Secure RAG-Enhanced AI Chatbot for Smart Tourism Customer Service: Defending Against Prompt Injection Attacks -- A Case Study of Hsinchu, Taiwan

Yu-Kai Shih, You-Kai Kang

机构 * Department of Information Management, National Dong Hwa University（信息管理系，国立东华大学） ； By The Student (BTS) Experimental Education Program (Non-School Type)（学生（BTS）实验教育计划（非学校类型）） 纠错

专题命中 RAG评测 ：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.AI

Comments 12 pages, 7 figures, 5 tables

An Iterative LLM Framework for SIBT utilizing RAG-based Adaptive Weight Optimization

Zhuo Xiao, Qinglong Yao, Jingjing Wang, Fugen Zhou, Bo Liu, Haitao Sun, Zhe Ji, Yuliang Jiang, Junjie Wang, Qiuwen Wu

机构 * Image Processing Center, Beihang University（北航图像处理中心） ； Department of Radiation Oncology, Peking University Third Hospital（北京大学第三医院放射肿瘤科） ； Department of Radiation Oncology, Duke University Medical Center（杜克大学医学中心放射肿瘤科） 纠错

专题命中 RAG评测 ：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.AI

FinRAGBench-V: A Benchmark for Multimodal RAG with Visual Citation in the Financial Domain

Suifeng Zhao, Zhuoran Jin, Sujian Li, Jun Gao

机构 * Key Laboratory of High Confidence Software Technologies, CS, Peking University, China（北京大学高可信软件技术重点实验室） ； School of Artificial Intelligence, University of Chinese Academy of Sciences（中国科学院大学人工智能学院） ； State Key Laboratory of Multimedia Information Processing, School of Computer Sciences, Peking University（北京大学多媒体信息处理国家重点实验室） 纠错

专题命中 RAG评测 ：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.CL

Mentalic Net: Development of RAG-based Conversational AI and Evaluation Framework for Mental Health Support

Anandi Dutta, Shivani Mruthyunjaya, Jessica Saddington, Kazi Sifatul Islam

专题命中 RAG评测 ：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.CL

Comments Preprint Version, Accepted in ISEMV 2025

FutureGen: A RAG-based Approach to Generate the Future Work of Scientific Article

Ibrahim Al Azher, Miftahul Jannat Mokarrama, Zhishuai Guo, Sagnik Ray Choudhury, Hamed Alhoori

机构 * Dept of Computer Science Northern Illinois University（计算机科学系 北伊利诺伊大学） ； Dept of Computer Science University of North Texas（计算机科学系 德克萨斯大学） 纠错

专题命中 RAG评测 ：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.CL

Comments 12 pages, 6 figures, Accepted for publication at the Workshop on AI Principles in Science Communication (Ai4SC'25), held in conjunction with the IEEE eScience Conference 2025

RAGAPHENE: A RAG Annotation Platform with Human Enhancements and Edits

Kshitij Fadnis, Sara Rosenthal, Maeda Hanafi, Yannis Katsis, Marina Danilevsky

机构 * IBM Research（IBM研究院） 纠错

专题命中 RAG评测 ：RAG(title,abstract)；retrieval augmented generation(abstract)；分类 cs.CL

PRGB Benchmark: A Robust Placeholder-Assisted Algorithm for Benchmarking Retrieval-Augmented Generation

Zhehao Tan, Yihan Jiao, Dan Yang, Lei Liu, Jie Feng, Duolin Sun, Yue Shen, Jian Wang, Peng Wei, Jinjie Gu

机构 * Zhehao Tan（未知） ； Yihan Jiao（未知） ； Dan Yang（未知） ； Lei Liu（未知） ； Jie Feng（未知） ； Duolin Sun（未知） ； Yue Shen（未知） ； Jian Wang（未知） ； Peng Wei（未知） ； Jinjie Gu（未知） 纠错

专题命中 RAG评测 ：retrieval-augmented generation(title,abstract)；RAG(abstract)；分类 cs.CL

Towards a rigorous evaluation of RAG systems: the challenge of due diligence

Grégoire Martinon, Alexandra Lorenzo de Brionne, Jérôme Bohard, Antoine Lojou, Damien Hervault, Nicolas J-B. Brunel

专题命中 RAG评测 ：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.AI

Comments in French language. EvalLLM2025: Workshop on Evaluation Generative Models (LLM) and Challenges, AMIAD, 2025, Marseille, France

An Empirical Study of Multi-Agent RAG for Real-World University Admissions Counseling

Anh Nguyen-Duc, Chien Vu Manh, Bao Anh Tran, Viet Phuong Ngo, Luan Le Chi, Anh Quang Nguyen

专题命中 RAG评测 ：RAG(title,abstract)；hybrid retrieval(abstract)；分类 cs.IR

Source Attribution in Retrieval-Augmented Generation

Ikhtiyor Nematov, Tarik Kalai, Elizaveta Kuzmenko, Gabriele Fugagnoli, Dimitris Sacharidis, Katja Hose, Tomer Sagi

机构 * Université Libre de Bruxelles, Belgium（布鲁塞尔自由大学） ； Aalborg University, Denmark（奥尔堡大学） ； University of Padova, Italy（帕多瓦大学） ； TU Wien, Austria（维也纳技术大学） 纠错

专题命中 RAG评测 ：retrieval-augmented generation(title,abstract)；RAG(abstract)；分类 cs.AI

AI-VaxGuide: An Agentic RAG-Based LLM for Vaccination Decisions

Abdellah Zeggai, Ilyes Traikia, Abdelhak Lakehal, Abdennour Boulesnane

机构 * Department of Fundamental Computing and its Applications, Faculty of NTIC（基础计算及其应用系） ； BIOSTIM Laboratory, Medicine Faculty Salah Boubnider Constantine 03 University（BIOSTIM实验室，医学系Salah Boubnider Constantine 03大学） 纠错

专题命中 RAG评测 ：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.CL

Assessing RAG and HyDE on 1B vs. 4B-Parameter Gemma LLMs for Personal Assistants Integretion

Andrejs Sorstkins

机构 * Lancaster University School of Computing and Communications（兰卡斯特大学计算机与通讯学院） 纠错

专题命中 RAG评测 ：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.CL

Comments Technical report as part of research project

Standard Applicability Judgment and Cross-jurisdictional Reasoning: A RAG-based Framework for Medical Device Compliance

Yu Han, Aaron Ceross, Jeroen H. M. Bergmann

专题命中 RAG评测 ：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.AI

PreQRAG -- Classify and Rewrite for Enhanced RAG

Damian Martinez, Catalina Riano, Hui Fang

专题命中 RAG评测 ：RAG(title,abstract)；retrieval augmented generation(abstract)；分类 cs.IR

Comments 7 pages, SIGIR 2025 LiveRAG