RAG / 检索增强生成

RAGAPHENE: A RAG Annotation Platform with Human Enhancements and Edits

Kshitij Fadnis, Sara Rosenthal, Maeda Hanafi, Yannis Katsis, Marina Danilevsky

机构 * IBM Research（IBM研究院） 纠错

专题命中 RAG评测 ：RAG(title,abstract)；retrieval augmented generation(abstract)；分类 cs.CL

PRGB Benchmark: A Robust Placeholder-Assisted Algorithm for Benchmarking Retrieval-Augmented Generation

Zhehao Tan, Yihan Jiao, Dan Yang, Lei Liu, Jie Feng, Duolin Sun, Yue Shen, Jian Wang, Peng Wei, Jinjie Gu

机构 * Zhehao Tan（未知） ； Yihan Jiao（未知） ； Dan Yang（未知） ； Lei Liu（未知） ； Jie Feng（未知） ； Duolin Sun（未知） ； Yue Shen（未知） ； Jian Wang（未知） ； Peng Wei（未知） ； Jinjie Gu（未知） 纠错

专题命中 RAG评测 ：retrieval-augmented generation(title,abstract)；RAG(abstract)；分类 cs.CL

Towards a rigorous evaluation of RAG systems: the challenge of due diligence

Grégoire Martinon, Alexandra Lorenzo de Brionne, Jérôme Bohard, Antoine Lojou, Damien Hervault, Nicolas J-B. Brunel

专题命中 RAG评测 ：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.AI

Comments in French language. EvalLLM2025: Workshop on Evaluation Generative Models (LLM) and Challenges, AMIAD, 2025, Marseille, France

An Empirical Study of Multi-Agent RAG for Real-World University Admissions Counseling

Anh Nguyen-Duc, Chien Vu Manh, Bao Anh Tran, Viet Phuong Ngo, Luan Le Chi, Anh Quang Nguyen

专题命中 RAG评测 ：RAG(title,abstract)；hybrid retrieval(abstract)；分类 cs.IR

Source Attribution in Retrieval-Augmented Generation

Ikhtiyor Nematov, Tarik Kalai, Elizaveta Kuzmenko, Gabriele Fugagnoli, Dimitris Sacharidis, Katja Hose, Tomer Sagi

机构 * Université Libre de Bruxelles, Belgium（布鲁塞尔自由大学） ； Aalborg University, Denmark（奥尔堡大学） ； University of Padova, Italy（帕多瓦大学） ； TU Wien, Austria（维也纳技术大学） 纠错

专题命中 RAG评测 ：retrieval-augmented generation(title,abstract)；RAG(abstract)；分类 cs.AI

AI-VaxGuide: An Agentic RAG-Based LLM for Vaccination Decisions

Abdellah Zeggai, Ilyes Traikia, Abdelhak Lakehal, Abdennour Boulesnane

机构 * Department of Fundamental Computing and its Applications, Faculty of NTIC（基础计算及其应用系） ； BIOSTIM Laboratory, Medicine Faculty Salah Boubnider Constantine 03 University（BIOSTIM实验室，医学系Salah Boubnider Constantine 03大学） 纠错

专题命中 RAG评测 ：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.CL

Assessing RAG and HyDE on 1B vs. 4B-Parameter Gemma LLMs for Personal Assistants Integretion

Andrejs Sorstkins

机构 * Lancaster University School of Computing and Communications（兰卡斯特大学计算机与通讯学院） 纠错

专题命中 RAG评测 ：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.CL

Comments Technical report as part of research project

Standard Applicability Judgment and Cross-jurisdictional Reasoning: A RAG-based Framework for Medical Device Compliance

Yu Han, Aaron Ceross, Jeroen H. M. Bergmann

专题命中 RAG评测 ：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.AI

PreQRAG -- Classify and Rewrite for Enhanced RAG

Damian Martinez, Catalina Riano, Hui Fang

专题命中 RAG评测 ：RAG(title,abstract)；retrieval augmented generation(abstract)；分类 cs.IR

Comments 7 pages, SIGIR 2025 LiveRAG

The Budget AI Researcher and the Power of RAG Chains

Franklin Lee, Tengfei Ma

专题命中 RAG评测 ：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.AI

Comments Intended for AAAI's AI4Research Workshop

Constructing and Evaluating Declarative RAG Pipelines in PyTerrier

Craig Macdonald, Jinyuan Fang, Andrew Parry, Zaiqiao Meng

专题命中 RAG评测 ：RAG(title,abstract)；retrieval augmented generation(abstract)；分类 cs.IR

Comments 4 pages, 3 tables, Accepted to SIGIR 2025

BRIGHT+: Upgrading the BRIGHT Benchmark with MARCUS, a Multi-Agent RAG Clean-Up Suite

Liyang Chen, Yujun Cai, Jieqiong Dong, Yiwei Wang

机构 * University of California, Los Angeles（加州大学洛杉矶分校） ； The University of Queensland（昆士兰大学） ； Central South University（中央南大学） ； University of California, Merced（加州大学默塞德分校） 纠错

专题命中 RAG评测 ：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.AI

Comments 8 pages, 7 figures, 4 tables. Submitted to EMNLP 2025

WeQA: A Benchmark for Retrieval Augmented Generation in Wind Energy Domain

Rounak Meyur, Hung Phan, Sridevi Wagle, Jan Strube, Mahantesh Halappanavar, Sameera Horawalavithana, Anurag Acharya, Sai Munikoti

机构 * Pacific Northwest National Laboratory（太平洋西北国家实验室） 纠错

专题命中 RAG评测 ：retrieval augmented generation(title,abstract)；RAG(abstract)；分类 cs.CL

Comments 8 pages without Limitation and References

Magic Mushroom: A Customizable Benchmark for Fine-grained Analysis of Retrieval Noise Erosion in RAG Systems

Yuxin Zhang, Yan Wang, Yongrui Chen, Shenyu Zhang, Xinbang Dai, Sheng Bi, Guilin Qi

机构 * School of Computer Science and Engineering, Southeast University, Nanjing 211189, China（计算机科学与工程学院，东南大学，南京211189，中国） ； Key Laboratory of New Generation Artificial Intelligence Technology and its Interdisciplinary Applications (Southeast University), Ministry of Education, China（新一代人工智能技术及其交叉应用重点实验室（东南大学），教育部，中国） ； School of Law, Southeast University, Nanjing 211189, China（法学院，东南大学，南京211189，中国） 纠错

专题命中 RAG评测 ：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.CL

IndicRAGSuite: Large-Scale Datasets and a Benchmark for Indian Language RAG Systems

Pasunuti Prasanjith, Prathmesh B More, Anoop Kunchukuttan, Raj Dabre

专题命中 RAG评测 ：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.CL

Comments WIP

Pandora's Box or Aladdin's Lamp: A Comprehensive Analysis Revealing the Role of RAG Noise in Large Language Models

Jinyang Wu, Shuai Zhang, Feihu Che, Mingkuan Feng, Chuyuan Zhang, Pengpeng Shao, Jianhua Tao

机构 * Department of Automation, Tsinghua University（自动化系，清华大学） ； Beijing National Research Center for Information Science and Technology（北京信息科学与技术国家研究中心） 纠错

专题命中 RAG评测 ：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.CL

Comments ACL 2025 Main

RAG-Zeval: Towards Robust and Interpretable Evaluation on RAG Responses through End-to-End Rule-Guided Reasoning

Kun Li, Yunxiang Li, Tianhua Zhang, Hongyin Luo, Xixin Wu, James Glass, Helen Meng

专题命中 RAG评测 ：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.CL

CReSt: A Comprehensive Benchmark for Retrieval-Augmented Generation with Complex Reasoning over Structured Documents

Minsoo Khang, Sangjun Park, Teakgyu Hong, Dawoon Jung

机构 * Upstage AI 纠错

专题命中 RAG评测 ：retrieval-augmented generation(title,abstract)；RAG(abstract)；分类 cs.CL

mmRAG: A Modular Benchmark for Retrieval-Augmented Generation over Text, Tables, and Knowledge Graphs

Chuan Xu, Qiaosheng Chen, Yutong Feng, Gong Cheng

专题命中 RAG评测 ：retrieval-augmented generation(title,abstract)；RAG(abstract)；分类 cs.IR

Towards Automated Situation Awareness: A RAG-Based Framework for Peacebuilding Reports

Poli A. Nemkova, Suleyman O. Polat, Rafid I. Jahan, Sagnik Ray Choudhury, Sun-joo Lee, Shouryadipta Sarkar, Mark V. Albert

机构 * Anonymous Submission（匿名提交） 纠错

专题命中 RAG评测 ：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.CL

WixQA: A Multi-Dataset Benchmark for Enterprise Retrieval-Augmented Generation

Dvir Cohen, Lin Burg, Sviatoslav Pykhnivskyi, Hagit Gur, Stanislav Kovynov, Olga Atzmon, Gilad Barkan

机构 * Wix.com AI Research（Wix.com人工智能研究） 纠错

专题命中 RAG评测 ：retrieval-augmented generation(title,abstract)；RAG(abstract)；分类 cs.AI

Retrieval Augmented Generation Evaluation for Health Documents

Mario Ceresa, Lorenzo Bertolini, Valentin Comte, Nicholas Spadaro, Barbara Raffael, Brigitte Toussaint, Sergio Consoli, Amalia Muñoz Piñeiro, Alex Patak, Maddalena Querci, Tobias Wiesenthal

专题命中 RAG评测 ：retrieval augmented generation(title,abstract)；RAG(abstract)；分类 cs.IR

Journal ref European Commission, Ispra, 2024, JRC138904

Ragas: Automated Evaluation of Retrieval Augmented Generation

Shahul Es, Jithin James, Luis Espinosa-Anke, Steven Schockaert

机构 * Exploding Gradients ； CardiffNLP, Cardiff University, United Kingdom（卡迪夫大学） ； AMPLYFI, United Kingdom（英国AMPLYFI） 纠错

专题命中 RAG评测 ：retrieval augmented generation(title,abstract)；RAG(abstract)；分类 cs.CL

Comments Reference-free (not tied to having ground truth available) evaluation framework for retrieval agumented generation

LRAGE: Legal Retrieval Augmented Generation Evaluation Tool

Minhu Park, Hongseok Oh, Eunkyung Choi, Wonseok Hwang

机构 * University of Seoul（首尔大学） 纠错

专题命中 RAG评测 ：retrieval augmented generation(title)；retrieval-augmented generation(abstract)；RAG(abstract)；分类 cs.CL

Comments 12 pages

A RAG-Based Multi-Agent LLM System for Natural Hazard Resilience and Adaptation

Yangxinyu Xie, Bowen Jiang, Tanwi Mallick, Joshua David Bergerson, John K. Hutchison, Duane R. Verner, Jordan Branham, M. Ross Alexander, Robert B. Ross, Yan Feng, Leslie-Anne Levy, Weijie Su, Camillo J. Taylor

机构 * Department of Statistics and Data Science, University of Pennsylvania（统计与数据科学系，宾夕法尼亚大学） ； Department of Computer and Information Science, University of Pennsylvania（计算机与信息科学系，宾夕法尼亚大学） ； Mathematics and Computer Science Division, Argonne National Laboratory（阿贡国家实验室数学与计算机科学 division） ； Decision and Infrastructure Sciences Division, Argonne National Laboratory（阿贡国家实验室决策与基础设施科学 division） ； Environmental Science Division, Argonne National Laboratory（阿贡国家实验室环境科学 division） 纠错

专题命中 RAG评测 ：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.CL

Measuring and Enhancing Trustworthiness of LLMs in RAG through Grounded Attributions and Learning to Refuse

Maojia Song, Shang Hong Sim, Rishabh Bhardwaj, Hai Leong Chieu, Navonil Majumder, Soujanya Poria

机构 * Singapore University of Technology and Design（新加坡科技设计大学） ； DSO National Laboratories（DSO国家实验室） 纠错

专题命中 RAG评测 ：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.CL

Comments Published at ICLR 2025 (Oral)

The Viability of Crowdsourcing for RAG Evaluation

Lukas Gienapp, Tim Hagen, Maik Fröbe, Matthias Hagen, Benno Stein, Martin Potthast, Harrisen Scells

专题命中 RAG评测 ：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.IR

Comments 11 pages, 9 tables, 5 figures. Accepted at SIGIR'25

Retrieval Augmented Generation Evaluation in the Era of Large Language Models: A Comprehensive Survey

Aoran Gan, Hao Yu, Kai Zhang, Qi Liu, Wenyu Yan, Zhenya Huang, Shiwei Tong, Guoping Hu

机构 * State Key Laboratory of Cognitive Intelligence, University of Science and Technology of China（认知智能国家重点实验室，中国科学技术大学） ； McGill University（麦吉尔大学） ； Tencent Company（腾讯公司） ； Artificial Intelligence Research Institute, iFLYTEK Co., Ltd（人工智能研究院，iFLYTEK公司） 纠错

专题命中 RAG评测 ：retrieval augmented generation(title)；retrieval-augmented generation(abstract)；RAG(abstract)；分类 cs.CL

Comments 18 pages, 5 figures

Unanswerability Evaluation for Retrieval Augmented Generation

Xiangyu Peng, Prafulla Kumar Choubey, Caiming Xiong, Chien-Sheng Wu

机构 * Salesforce Research（Salesforce 研究） 纠错

专题命中 RAG评测 ：retrieval augmented generation(title)；retrieval-augmented generation(abstract)；RAG(abstract)；分类 cs.CL

A Survey of Personalization: From RAG to Agent

Xiaopeng Li, Pengyue Jia, Derong Xu, Yi Wen, Yingyi Zhang, Wenlin Zhang, Wanyu Wang, Yichao Wang, Zhaocheng Du, Xiangyang Li, Yong Liu, Huifeng Guo, Ruiming Tang, Xiangyu Zhao

专题命中 RAG评测 ：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.IR

Comments 18 pages, 5 figures