RAG / 检索增强生成 - arXivDaily 专题

2504.15629 2025-06-12 cs.IR cs.CL 84%

CiteFix: Enhancing RAG Accuracy Through Post-Processing Citation Correction

Harsh Maheshwari, Srikanth Tenneti, Alwarappan Nakkiran

专题命中 RAG评测：RAG(title,abstract)；retrieval augmented generation(abstract)；分类 cs.IR、cs.CL

2505.18581 2025-05-27 cs.CL cs.AI 84%

Removal of Hallucination on Hallucination: Debate-Augmented RAG

Wentao Hu, Wengyu Zhang, Yiyang Jiang, Chen Jason Zhang, Xiaoyong Wei, Qing Li

专题命中 RAG评测：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.CL、cs.AI

Comments Accepted by ACL 2025

2406.14783 2025-05-26 cs.IR cs.CL 84%

Evaluating RAG-Fusion with RAGElo: an Automated Elo-based Framework

Zackary Rackauckas, Arthur Câmara, Jakub Zavrel

专题命中 RAG评测：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.IR、cs.CL

Comments Accepted to LLM4Eval @ SIGIR24

Journal ref Proceedings of The First Workshop on Large Language Models for Evaluation in Information Retrieval (LLM4Eval 2024) co-located with 10th International Conference on Online Publishing (SIGIR 2024)

2505.09031 2025-05-15 cs.AI cs.CL 84%

Improving the Reliability of LLMs: Combining CoT, RAG, Self-Consistency, and Self-Verification

Adarsh Kumar, Hwiyoon Kim, Jawahar Sai Nathani, Neil Roy

机构 * Computer Science and Engineering Texas A&M University（计算机科学与工程，德克萨斯农工大学）

专题命中 RAG评测：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.CL、cs.AI

2502.18635 2025-05-09 cs.LG cs.AI cs.CL 84%

Faster, Cheaper, Better: Multi-Objective Hyperparameter Optimization for LLM and RAG Systems

Matthew Barker, Andrew Bell, Evan Thomas, James Carr, Thomas Andrews, Umang Bhatt

机构 * Trustwise AI ； New York University（纽约大学）； The Alan Turing Institute（艾伦·图灵研究所）

专题命中 RAG评测：RAG(title,abstract)；retrieval augmented generation(abstract)；分类 cs.CL、cs.AI

2505.00263 2025-05-02 cs.IR cs.CL 84%

EnronQA: Towards Personalized RAG over Private Documents

Michael J. Ryan, Danmei Xu, Chris Nivera, Daniel Campos

机构 * Stanford University（斯坦福大学）； Snowflake（Snowflake公司）

专题命中 RAG评测：RAG(title,abstract)；retrieval augmented generation(abstract)；分类 cs.IR、cs.CL

Comments 26 pages, 4 figures, 6 tables

2504.15068 2025-04-22 cs.IR cs.CL 84%

The Great Nugget Recall: Automating Fact Extraction and RAG Evaluation with Large Language Models

Ronak Pradeep, Nandan Thakur, Shivani Upadhyay, Daniel Campos, Nick Craswell, Jimmy Lin

机构 * University of Waterloo（滑铁卢大学）； Snowflake ； Microsoft（微软）

专题命中 RAG评测：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.IR、cs.CL

Comments To appear in SIGIR 2025. Significant updates and revisions to arXiv:2411.09607

2504.07803 2025-04-11 cs.CL cs.AI cs.LG 84%

A System for Comprehensive Assessment of RAG Frameworks

Mattia Rengo, Senad Beadini, Domenico Alfano, Roberto Abbruzzese

专题命中 RAG评测：RAG(title,abstract)；retrieval augmented generation(abstract)；分类 cs.CL、cs.AI

Comments Technical Report, 7 pages, 2 figures, 1 table

2410.13716 2025-04-01 cs.CL cs.AI 84%

MIRAGE-Bench: Automatic Multilingual Benchmark Arena for Retrieval-Augmented Generation Systems

Nandan Thakur, Suleman Kazi, Ge Luo, Jimmy Lin, Amin Ahmad

专题命中 RAG评测：retrieval-augmented generation(title,abstract)；RAG(abstract)；分类 cs.CL、cs.AI

Comments Accepted at NAACL 2025 (Main Conference)

2503.10702 2025-03-17 cs.CL cs.IR 84%

ClaimTrust: Propagation Trust Scoring for RAG Systems

Hangkai Qian, Bo Li, Qichen Wang

专题命中 RAG评测：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.IR、cs.CL

Comments 6 pages, 2 figures, 1 table

2408.01262 2025-03-05 cs.CL cs.IR 84%

RAGEval: Scenario Specific RAG Evaluation Dataset Generation Framework

Kunlun Zhu, Yifan Luo, Dingling Xu, Yukun Yan, Zhenghao Liu, Shi Yu, Ruobing Wang, Shuo Wang, Yishan Li, Nan Zhang, Xu Han, Zhiyuan Liu, Maosong Sun

专题命中 RAG评测：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.IR、cs.CL

Comments https://github.com/OpenBMB/RAGEval

2502.17125 2025-02-25 cs.CL cs.AI 84%

LettuceDetect: A Hallucination Detection Framework for RAG Applications

Ádám Kovács, Gábor Recski

专题命中 RAG评测：RAG(title,abstract)；retrieval augmented generation(abstract)；分类 cs.CL、cs.AI

Comments 6 pages

2502.15854 2025-02-25 cs.LG cs.AI cs.CL 84%

Enhancing Domain-Specific Retrieval-Augmented Generation: Synthetic Data Generation and Evaluation using Reasoning Models

Aryan Jadon, Avinash Patil, Shashank Kumar

专题命中 RAG评测：retrieval-augmented generation(title,abstract)；RAG(abstract)；分类 cs.CL、cs.AI

Comments 8 Pages

2411.02850 2025-02-19 cs.CY cs.AI cs.HC cs.IR 84%

WASHtsApp -- A RAG-powered WhatsApp Chatbot for supporting rural African clean water access, sanitation and hygiene

Simon Kloker, Alex Cedric Luyima, Matthew Bazanya

专题命中 RAG评测：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.IR、cs.AI

Comments Working Paper. Accepted at IST-Africa Conference 2025, Nairobi

2405.07437 2025-02-17 cs.CL cs.AI 84%

Evaluation of Retrieval-Augmented Generation: A Survey

Hao Yu, Aoran Gan, Kai Zhang, Shiwei Tong, Qi Liu, Zhaofeng Liu

专题命中 RAG评测：retrieval-augmented generation(title,abstract)；RAG(abstract)；分类 cs.CL、cs.AI

2407.12101 2025-02-14 cs.CL cs.AI 84%

Better RAG using Relevant Information Gain

Marc Pickett, Jeremy Hartman, Ayan Kumar Bhowmick, Raquib-ul Alam, Aditya Vempaty

专题命中 RAG评测：RAG(title,abstract)；retrieval augmented generation(abstract)；分类 cs.CL、cs.AI

Comments 4 page paper submitted to EMNLP

2501.12789 2025-01-23 cs.CL cs.IR 84%

Generating Diverse Q&A Benchmarks for RAG Evaluation with DataMorgana

Simone Filice, Guy Horowitz, David Carmel, Zohar Karnin, Liane Lewin-Eytan, Yoelle Maarek

专题命中 RAG评测：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.IR、cs.CL

2412.13720 2025-01-09 cs.CL cs.AI 84%

Federated Learning and RAG Integration: A Scalable Approach for Medical Large Language Models

Jincheol Jung, Hongju Jeong, Eui-Nam Huh

专题命中 RAG评测：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.CL、cs.AI

2501.03468 2025-01-08 cs.CL cs.AI 84%

MTRAG: A Multi-Turn Conversational Benchmark for Evaluating Retrieval-Augmented Generation Systems

Yannis Katsis, Sara Rosenthal, Kshitij Fadnis, Chulaka Gunasekara, Young-Suk Lee, Lucian Popa, Vraj Shah, Huaiyu Zhu, Danish Contractor, Marina Danilevsky

专题命中 RAG评测：retrieval-augmented generation(title,abstract)；RAG(abstract)；分类 cs.CL、cs.AI

2412.14510 2024-12-20 cs.CL cs.AI 84%

PA-RAG: RAG Alignment via Multi-Perspective Preference Optimization

Jiayi Wu, Hengyi Cai, Lingyong Yan, Hao Sun, Xiang Li, Shuaiqiang Wang, Dawei Yin, Ming Gao

专题命中 RAG评测：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.CL、cs.AI

2412.10151 2024-12-16 cs.CV cs.AI cs.CL 84%

VLR-Bench: Multilingual Benchmark Dataset for Vision-Language Retrieval Augmented Generation

Hyeonseok Lim, Dongjae Shin, Seohyun Song, Inho Won, Minjun Kim, Junghun Yuk, Haneol Jang, KyungTae Lim

专题命中 RAG评测：retrieval augmented generation(title,abstract)；RAG(abstract)；分类 cs.CL、cs.AI

Comments The 31st International Conference on Computational Linguistics (COLING 2025), 19 pages

2406.13663 2024-12-02 cs.CL cs.AI cs.LG 84%

Model Internals-based Answer Attribution for Trustworthy Retrieval-Augmented Generation

Jirui Qi, Gabriele Sarti, Raquel Fernández, Arianna Bisazza

专题命中 RAG评测：retrieval-augmented generation(title,abstract)；RAG(abstract)；分类 cs.CL、cs.AI

Comments Accepted by EMNLP 2024 Main Conference. Code and data released at https://github.com/Betswish/MIRAGE

Journal ref Proceedings of EMNLP (2024) 6037-6053

2411.09607 2024-11-15 cs.IR cs.CL 84%

Initial Nugget Evaluation Results for the TREC 2024 RAG Track with the AutoNuggetizer Framework

Ronak Pradeep, Nandan Thakur, Shivani Upadhyay, Daniel Campos, Nick Craswell, Jimmy Lin

专题命中 RAG评测：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.IR、cs.CL

2406.15187 2024-11-01 cs.AI cs.IR 84%

UDA: A Benchmark Suite for Retrieval Augmented Generation in Real-world Document Analysis

Yulong Hui, Yao Lu, Huanchen Zhang

专题命中 RAG评测：retrieval augmented generation(title)；retrieval-augmented generation(abstract)；RAG(abstract)；分类 cs.IR、cs.AI

2409.15763 2024-09-27 cs.IR cs.AI 84%

IRSC: A Zero-shot Evaluation Benchmark for Information Retrieval through Semantic Comprehension in Retrieval-Augmented Generation Scenarios

Hai Lin, Shaoxiong Zhan, Junyou Su, Haitao Zheng, Hui Wang

专题命中 RAG评测：retrieval-augmented generation(title,abstract)；RAG(abstract)；分类 cs.IR、cs.AI

2409.09916 2024-09-17 cs.CL cs.AI 84%

SFR-RAG: Towards Contextually Faithful LLMs

Xuan-Phi Nguyen, Shrey Pandit, Senthil Purushwalkam, Austin Xu, Hailin Chen, Yifei Ming, Zixuan Ke, Silvio Savarese, Caiming Xong, Shafiq Joty

专题命中 RAG评测：RAG(title,abstract)；retrieval augmented generation(abstract)；分类 cs.CL、cs.AI

Comments Technical report

2405.17587 2024-08-19 cs.IR cs.CL cs.LG 84%

RAGSys: Item-Cold-Start Recommender as RAG System

Emile Contal, Garrin McGoldrick

专题命中 RAG评测：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.IR、cs.CL

2407.12057 2024-07-18 cs.CL cs.AI 84%

NinjaLLM: Fast, Scalable and Cost-effective RAG using Amazon SageMaker and AWS Trainium and Inferentia2

Tengfei Xue, Xuefeng Li, Roman Smirnov, Tahir Azim, Arash Sadrieh, Babak Pahlavan

专题命中 RAG评测：RAG(title,abstract)；retrieval-augmented generation(abstract)；分类 cs.CL、cs.AI

2407.01080 2024-07-10 cs.CL cs.AI 84%

Face4RAG: Factual Consistency Evaluation for Retrieval Augmented Generation in Chinese

Yunqi Xu, Tianchi Cai, Jiyan Jiang, Xierui Song

专题命中 RAG评测：retrieval augmented generation(title,abstract)；RAG(abstract)；分类 cs.CL、cs.AI

Journal ref KDD 2024 (oral)

2406.05654 2024-06-18 cs.CL cs.IR 84%

DomainRAG: A Chinese Benchmark for Evaluating Domain-specific Retrieval-Augmented Generation

Shuting Wang, Jiongnan Liu, Shiren Song, Jiehan Cheng, Yuqi Fu, Peidong Guo, Kun Fang, Yutao Zhu, Zhicheng Dou

专题命中 RAG评测：retrieval-augmented generation(title,abstract)；RAG(abstract)；分类 cs.IR、cs.CL

1. RAG评测 1223 篇

CiteFix: Enhancing RAG Accuracy Through Post-Processing Citation Correction

Removal of Hallucination on Hallucination: Debate-Augmented RAG

Evaluating RAG-Fusion with RAGElo: an Automated Elo-based Framework

Improving the Reliability of LLMs: Combining CoT, RAG, Self-Consistency, and Self-Verification

Faster, Cheaper, Better: Multi-Objective Hyperparameter Optimization for LLM and RAG Systems

EnronQA: Towards Personalized RAG over Private Documents

The Great Nugget Recall: Automating Fact Extraction and RAG Evaluation with Large Language Models

A System for Comprehensive Assessment of RAG Frameworks

MIRAGE-Bench: Automatic Multilingual Benchmark Arena for Retrieval-Augmented Generation Systems

ClaimTrust: Propagation Trust Scoring for RAG Systems

RAGEval: Scenario Specific RAG Evaluation Dataset Generation Framework

LettuceDetect: A Hallucination Detection Framework for RAG Applications

Enhancing Domain-Specific Retrieval-Augmented Generation: Synthetic Data Generation and Evaluation using Reasoning Models

WASHtsApp -- A RAG-powered WhatsApp Chatbot for supporting rural African clean water access, sanitation and hygiene

Evaluation of Retrieval-Augmented Generation: A Survey

Better RAG using Relevant Information Gain

Generating Diverse Q&A Benchmarks for RAG Evaluation with DataMorgana

Federated Learning and RAG Integration: A Scalable Approach for Medical Large Language Models

MTRAG: A Multi-Turn Conversational Benchmark for Evaluating Retrieval-Augmented Generation Systems

PA-RAG: RAG Alignment via Multi-Perspective Preference Optimization

VLR-Bench: Multilingual Benchmark Dataset for Vision-Language Retrieval Augmented Generation

Model Internals-based Answer Attribution for Trustworthy Retrieval-Augmented Generation

Initial Nugget Evaluation Results for the TREC 2024 RAG Track with the AutoNuggetizer Framework

UDA: A Benchmark Suite for Retrieval Augmented Generation in Real-world Document Analysis

IRSC: A Zero-shot Evaluation Benchmark for Information Retrieval through Semantic Comprehension in Retrieval-Augmented Generation Scenarios

SFR-RAG: Towards Contextually Faithful LLMs

RAGSys: Item-Cold-Start Recommender as RAG System

NinjaLLM: Fast, Scalable and Cost-effective RAG using Amazon SageMaker and AWS Trainium and Inferentia2

Face4RAG: Factual Consistency Evaluation for Retrieval Augmented Generation in Chinese

DomainRAG: A Chinese Benchmark for Evaluating Domain-specific Retrieval-Augmented Generation