RAG / 检索增强生成 - arXivDaily 专题

2506.12317 2025-06-17 cs.AI 83%

The Budget AI Researcher and the Power of RAG Chains

Franklin Lee, Tengfei Ma

专题命中 RAG评测：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.AI

Comments Intended for AAAI's AI4Research Workshop

2506.10802 2025-06-13 cs.IR 83%

Constructing and Evaluating Declarative RAG Pipelines in PyTerrier

Craig Macdonald, Jinyuan Fang, Andrew Parry, Zaiqiao Meng

专题命中 RAG评测：RAG(title,abstract)；retrieval augmented generation(abstract)；分类 cs.IR

Comments 4 pages, 3 tables, Accepted to SIGIR 2025

2506.07116 2025-06-10 cs.AI 83%

BRIGHT+: Upgrading the BRIGHT Benchmark with MARCUS, a Multi-Agent RAG Clean-Up Suite

Liyang Chen, Yujun Cai, Jieqiong Dong, Yiwei Wang

机构 * University of California, Los Angeles（加州大学洛杉矶分校）； The University of Queensland（昆士兰大学）； Central South University（中央南大学）； University of California, Merced（加州大学默塞德分校）

专题命中 RAG评测：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.AI

Comments 8 pages, 7 figures, 4 tables. Submitted to EMNLP 2025

2408.11800 2025-06-10 cs.CL 83%

WeQA: A Benchmark for Retrieval Augmented Generation in Wind Energy Domain

Rounak Meyur, Hung Phan, Sridevi Wagle, Jan Strube, Mahantesh Halappanavar, Sameera Horawalavithana, Anurag Acharya, Sai Munikoti

机构 * Pacific Northwest National Laboratory（太平洋西北国家实验室）

专题命中 RAG评测：retrieval augmented generation(title,abstract)；RAG(abstract)；分类 cs.CL

Comments 8 pages without Limitation and References

2506.03901 2025-06-06 cs.CL 83%

Magic Mushroom: A Customizable Benchmark for Fine-grained Analysis of Retrieval Noise Erosion in RAG Systems

Yuxin Zhang, Yan Wang, Yongrui Chen, Shenyu Zhang, Xinbang Dai, Sheng Bi, Guilin Qi

机构 * School of Computer Science and Engineering, Southeast University, Nanjing 211189, China（计算机科学与工程学院，东南大学，南京211189，中国）； Key Laboratory of New Generation Artificial Intelligence Technology and its Interdisciplinary Applications (Southeast University), Ministry of Education, China（新一代人工智能技术及其交叉应用重点实验室（东南大学），教育部，中国）； School of Law, Southeast University, Nanjing 211189, China（法学院，东南大学，南京211189，中国）

专题命中 RAG评测：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.CL

2506.01615 2025-06-04 cs.CL 83%

IndicRAGSuite: Large-Scale Datasets and a Benchmark for Indian Language RAG Systems

Pasunuti Prasanjith, Prathmesh B More, Anoop Kunchukuttan, Raj Dabre

专题命中 RAG评测：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.CL

Comments WIP

2408.13533 2025-06-03 cs.CL 83%

Pandora's Box or Aladdin's Lamp: A Comprehensive Analysis Revealing the Role of RAG Noise in Large Language Models

Jinyang Wu, Shuai Zhang, Feihu Che, Mingkuan Feng, Chuyuan Zhang, Pengpeng Shao, Jianhua Tao

机构 * Department of Automation, Tsinghua University（自动化系，清华大学）； Beijing National Research Center for Information Science and Technology（北京信息科学与技术国家研究中心）

专题命中 RAG评测：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.CL

Comments ACL 2025 Main

2505.22430 2025-05-29 cs.CL 83%

RAG-Zeval: Towards Robust and Interpretable Evaluation on RAG Responses through End-to-End Rule-Guided Reasoning

Kun Li, Yunxiang Li, Tianhua Zhang, Hongyin Luo, Xixin Wu, James Glass, Helen Meng

专题命中 RAG评测：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.CL

2505.17503 2025-05-26 cs.CL 83%

CReSt: A Comprehensive Benchmark for Retrieval-Augmented Generation with Complex Reasoning over Structured Documents

Minsoo Khang, Sangjun Park, Teakgyu Hong, Dawoon Jung

机构 * Upstage AI

专题命中 RAG评测：retrieval-augmented generation(title,abstract)；RAG(abstract)；分类 cs.CL

2505.11180 2025-05-19 cs.IR 83%

mmRAG: A Modular Benchmark for Retrieval-Augmented Generation over Text, Tables, and Knowledge Graphs

Chuan Xu, Qiaosheng Chen, Yutong Feng, Gong Cheng

专题命中 RAG评测：retrieval-augmented generation(title,abstract)；RAG(abstract)；分类 cs.IR

2505.10586 2025-05-19 cs.CY cs.CL 83%

Towards Automated Situation Awareness: A RAG-Based Framework for Peacebuilding Reports

Poli A. Nemkova, Suleyman O. Polat, Rafid I. Jahan, Sagnik Ray Choudhury, Sun-joo Lee, Shouryadipta Sarkar, Mark V. Albert

机构 * Anonymous Submission（匿名提交）

专题命中 RAG评测：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.CL

2505.08643 2025-05-14 cs.AI cs.LG 83%

WixQA: A Multi-Dataset Benchmark for Enterprise Retrieval-Augmented Generation

Dvir Cohen, Lin Burg, Sviatoslav Pykhnivskyi, Hagit Gur, Stanislav Kovynov, Olga Atzmon, Gilad Barkan

机构 * Wix.com AI Research（Wix.com人工智能研究）

专题命中 RAG评测：retrieval-augmented generation(title,abstract)；RAG(abstract)；分类 cs.AI

2505.04680 2025-05-09 cs.IR 83%

Retrieval Augmented Generation Evaluation for Health Documents

Mario Ceresa, Lorenzo Bertolini, Valentin Comte, Nicholas Spadaro, Barbara Raffael, Brigitte Toussaint, Sergio Consoli, Amalia Muñoz Piñeiro, Alex Patak, Maddalena Querci, Tobias Wiesenthal

专题命中 RAG评测：retrieval augmented generation(title,abstract)；RAG(abstract)；分类 cs.IR

Journal ref European Commission, Ispra, 2024, JRC138904

2309.15217 2025-04-29 cs.CL 83%

Ragas: Automated Evaluation of Retrieval Augmented Generation

Shahul Es, Jithin James, Luis Espinosa-Anke, Steven Schockaert

机构 * Exploding Gradients ； CardiffNLP, Cardiff University, United Kingdom（卡迪夫大学）； AMPLYFI, United Kingdom（英国AMPLYFI）

专题命中 RAG评测：retrieval augmented generation(title,abstract)；RAG(abstract)；分类 cs.CL

Comments Reference-free (not tied to having ground truth available) evaluation framework for retrieval agumented generation

2504.01840 2025-04-28 cs.CL 83%

LRAGE: Legal Retrieval Augmented Generation Evaluation Tool

Minhu Park, Hongseok Oh, Eunkyung Choi, Wonseok Hwang

机构 * University of Seoul（首尔大学）

专题命中 RAG评测：retrieval augmented generation(title)；retrieval-augmented generation(abstract)；RAG(abstract)；分类 cs.CL

Comments 12 pages

2504.17200 2025-04-25 cs.CL 83%

A RAG-Based Multi-Agent LLM System for Natural Hazard Resilience and Adaptation

Yangxinyu Xie, Bowen Jiang, Tanwi Mallick, Joshua David Bergerson, John K. Hutchison, Duane R. Verner, Jordan Branham, M. Ross Alexander, Robert B. Ross, Yan Feng, Leslie-Anne Levy, Weijie Su, Camillo J. Taylor

机构 * Department of Statistics and Data Science, University of Pennsylvania（统计与数据科学系，宾夕法尼亚大学）； Department of Computer and Information Science, University of Pennsylvania（计算机与信息科学系，宾夕法尼亚大学）； Mathematics and Computer Science Division, Argonne National Laboratory（阿贡国家实验室数学与计算机科学 division）； Decision and Infrastructure Sciences Division, Argonne National Laboratory（阿贡国家实验室决策与基础设施科学 division）； Environmental Science Division, Argonne National Laboratory（阿贡国家实验室环境科学 division）

专题命中 RAG评测：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.CL

2409.11242 2025-04-25 cs.CL 83%

Measuring and Enhancing Trustworthiness of LLMs in RAG through Grounded Attributions and Learning to Refuse

Maojia Song, Shang Hong Sim, Rishabh Bhardwaj, Hai Leong Chieu, Navonil Majumder, Soujanya Poria

机构 * Singapore University of Technology and Design（新加坡科技设计大学）； DSO National Laboratories（DSO国家实验室）

专题命中 RAG评测：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.CL

Comments Published at ICLR 2025 (Oral)

2504.15689 2025-04-23 cs.IR 83%

The Viability of Crowdsourcing for RAG Evaluation

Lukas Gienapp, Tim Hagen, Maik Fröbe, Matthias Hagen, Benno Stein, Martin Potthast, Harrisen Scells

专题命中 RAG评测：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.IR

Comments 11 pages, 9 tables, 5 figures. Accepted at SIGIR'25

2504.14891 2025-04-22 cs.CL 83%

Retrieval Augmented Generation Evaluation in the Era of Large Language Models: A Comprehensive Survey

Aoran Gan, Hao Yu, Kai Zhang, Qi Liu, Wenyu Yan, Zhenya Huang, Shiwei Tong, Guoping Hu

机构 * State Key Laboratory of Cognitive Intelligence, University of Science and Technology of China（认知智能国家重点实验室，中国科学技术大学）； McGill University（麦吉尔大学）； Tencent Company（腾讯公司）； Artificial Intelligence Research Institute, iFLYTEK Co., Ltd（人工智能研究院，iFLYTEK公司）

专题命中 RAG评测：retrieval augmented generation(title)；retrieval-augmented generation(abstract)；RAG(abstract)；分类 cs.CL

Comments 18 pages, 5 figures

2412.12300 2025-04-22 cs.CL 83%

Unanswerability Evaluation for Retrieval Augmented Generation

Xiangyu Peng, Prafulla Kumar Choubey, Caiming Xiong, Chien-Sheng Wu

机构 * Salesforce Research（Salesforce 研究）

专题命中 RAG评测：retrieval augmented generation(title)；retrieval-augmented generation(abstract)；RAG(abstract)；分类 cs.CL

2504.10147 2025-04-15 cs.IR 83%

A Survey of Personalization: From RAG to Agent

Xiaopeng Li, Pengyue Jia, Derong Xu, Yi Wen, Yingyi Zhang, Wenlin Zhang, Wanyu Wang, Yichao Wang, Zhaocheng Du, Xiangyang Li, Yong Liu, Huifeng Guo, Ruiming Tang, Xiangyu Zhao

专题命中 RAG评测：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.IR

Comments 18 pages, 5 figures

2504.01866 2025-04-08 cs.SE cs.AI cs.PL 83%

From Code Generation to Software Testing: AI Copilot with Context-Based RAG

Yuchen Wang, Shangxin Guo, Chee Wei Tan

专题命中 RAG评测：RAG(title,abstract)；retrieval augmented generation(abstract)；分类 cs.AI

Comments This work has been accepted for publication in IEEE Software (DOI: 10.1109/MS.2025.3549628)

2501.11551 2025-03-13 cs.CL 83%

PIKE-RAG: sPecIalized KnowledgE and Rationale Augmented Generation

Jinyu Wang, Jingjing Fu, Rui Wang, Lei Song, Jiang Bian

专题命中 RAG评测：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.CL

Comments 38 pages, 18 figures, technique report

2502.19209 2025-02-27 cs.CL 83%

Bi'an: A Bilingual Benchmark and Model for Hallucination Detection in Retrieval-Augmented Generation

Zhouyu Jiang, Mengshu Sun, Zhiqiang Zhang, Lei Liang

专题命中 RAG评测：retrieval-augmented generation(title,abstract)；RAG(abstract)；分类 cs.CL

2502.18817 2025-02-27 cs.CL 83%

Judge as A Judge: Improving the Evaluation of Retrieval-Augmented Generation through the Judge-Consistency of Large Language Models

Shuliang Liu, Xinze Li, Zhenghao Liu, Yukun Yan, Cheng Yang, Zheni Zeng, Zhiyuan Liu, Maosong Sun, Ge Yu

专题命中 RAG评测：retrieval-augmented generation(title,abstract)；RAG(abstract)；分类 cs.CL

2502.12342 2025-02-19 cs.IR cs.CV 83%

REAL-MM-RAG: A Real-World Multi-Modal Retrieval Benchmark

Navve Wasserman, Roi Pony, Oshri Naparstek, Adi Raz Goldfarb, Eli Schwartz, Udi Barzelay, Leonid Karlinsky

专题命中 RAG评测：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.IR

2412.13018 2025-02-18 cs.CL 83%

OmniEval: An Omnidirectional and Automatic RAG Evaluation Benchmark in Financial Domain

Shuting Wang, Jiejun Tan, Zhicheng Dou, Ji-Rong Wen

专题命中 RAG评测：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.CL

2502.09073 2025-02-14 cs.CL 83%

Enhancing RAG with Active Learning on Conversation Records: Reject Incapables and Answer Capables

Xuzhao Geng, Haozhao Wang, Jun Wang, Wei Liu, Ruixuan Li

专题命中 RAG评测：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.CL

2501.14733 2025-01-28 cs.DC cs.AI 83%

LLM as HPC Expert: Extending RAG Architecture for HPC Data

Yusuke Miyashita, Patrick Kin Man Tung, Johan Barthélemy

专题命中 RAG评测：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.AI

Comments preprint

2409.12941 2025-01-28 cs.CL 83%

Fact, Fetch, and Reason: A Unified Evaluation of Retrieval-Augmented Generation

Satyapriya Krishna, Kalpesh Krishna, Anhad Mohananey, Steven Schwarcz, Adam Stambler, Shyam Upadhyay, Manaal Faruqui

专题命中 RAG评测：retrieval-augmented generation(title,abstract)；RAG(abstract)；分类 cs.CL

Comments Annual Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics (NAACL), 2025

1. RAG评测 1226 篇

The Budget AI Researcher and the Power of RAG Chains

Constructing and Evaluating Declarative RAG Pipelines in PyTerrier

BRIGHT+: Upgrading the BRIGHT Benchmark with MARCUS, a Multi-Agent RAG Clean-Up Suite

WeQA: A Benchmark for Retrieval Augmented Generation in Wind Energy Domain

Magic Mushroom: A Customizable Benchmark for Fine-grained Analysis of Retrieval Noise Erosion in RAG Systems

IndicRAGSuite: Large-Scale Datasets and a Benchmark for Indian Language RAG Systems

Pandora's Box or Aladdin's Lamp: A Comprehensive Analysis Revealing the Role of RAG Noise in Large Language Models

RAG-Zeval: Towards Robust and Interpretable Evaluation on RAG Responses through End-to-End Rule-Guided Reasoning

CReSt: A Comprehensive Benchmark for Retrieval-Augmented Generation with Complex Reasoning over Structured Documents

mmRAG: A Modular Benchmark for Retrieval-Augmented Generation over Text, Tables, and Knowledge Graphs

Towards Automated Situation Awareness: A RAG-Based Framework for Peacebuilding Reports

WixQA: A Multi-Dataset Benchmark for Enterprise Retrieval-Augmented Generation

Retrieval Augmented Generation Evaluation for Health Documents

Ragas: Automated Evaluation of Retrieval Augmented Generation

LRAGE: Legal Retrieval Augmented Generation Evaluation Tool

A RAG-Based Multi-Agent LLM System for Natural Hazard Resilience and Adaptation

Measuring and Enhancing Trustworthiness of LLMs in RAG through Grounded Attributions and Learning to Refuse

The Viability of Crowdsourcing for RAG Evaluation

Retrieval Augmented Generation Evaluation in the Era of Large Language Models: A Comprehensive Survey

Unanswerability Evaluation for Retrieval Augmented Generation

A Survey of Personalization: From RAG to Agent

From Code Generation to Software Testing: AI Copilot with Context-Based RAG

PIKE-RAG: sPecIalized KnowledgE and Rationale Augmented Generation

Bi'an: A Bilingual Benchmark and Model for Hallucination Detection in Retrieval-Augmented Generation

Judge as A Judge: Improving the Evaluation of Retrieval-Augmented Generation through the Judge-Consistency of Large Language Models

REAL-MM-RAG: A Real-World Multi-Modal Retrieval Benchmark

OmniEval: An Omnidirectional and Automatic RAG Evaluation Benchmark in Financial Domain

Enhancing RAG with Active Learning on Conversation Records: Reject Incapables and Answer Capables

LLM as HPC Expert: Extending RAG Architecture for HPC Data

Fact, Fetch, and Reason: A Unified Evaluation of Retrieval-Augmented Generation