Retrieved But Not Reliable: A Survey on Attacks, and Defenses in Retrieval-Augmented Generation
可检索但不可靠:检索增强生成中的攻击与防御研究综述
Minh Tran, Cuong Dang, Tuc Nguyen, Khanh-Tung Tran, Minh Huynh Nguyen, Trinh Chau, Kien Le, Do Xuan Long, Jiahao Zhang, Fali Wang, Hoang D. Nguyen, Thanh Le, Suhang Wang
Comments24 pages, 6 figures. Accepted to Findings of the Association for Computational Linguistics: EMNLP 2026. Peer-reviewed through ACL Rolling Review (ARR)
机构
*
State Key Laboratory of AI Safety, Institute of Computing Technology, Chinese Academy of Sciences(人工智能安全国家重点实验室,计算技术研究所,中国科学院)
;
University of Chinese Academy of Sciences(中国科学院大学)
;
Baidu Inc(百度公司)
Commentsv2: Adds an adaptive-attacker evaluation in which Ring 1 is fully evaded (500/500 documents, three corpora); scales to the full NQ, HotpotQA and MS-MARCO corpora; corrects Proposition 1, whose boundary is corpus-dependent (0.214/0.251/0.558) not 0.5; retracts a proposed closed form after a pre-registered prediction failed. The v1 headline 91%-to-13% result is withdrawn
机构
*
CAS Key Lab of Network Data Science and Technology, ICT, CAS(中国科学院网络数据科学与技术重点实验室)
;
University of Chinese Academy of Sciences(中国科学院大学)
;
Baidu Inc(百度公司)
Commentsv3: strengthened retrieval analysis rank-biased overlap and paired randomization tests for Run B vs Run C, with a difference-in-differences localising the advantage to the frozen physiology stream; methods clarifications throughout. 12 pages, 4 figures, 7 tables. Under review
Distinct Profiles of Run-to-Run Score Reliability and Expert-Panel Alignment Across Four LLM Evaluators of Simulated Japanese-Language AI-to-AI Counseling
机构
*
Japan National Institute of Occupational Safety and Health(日本国立职业安全卫生研究所)
;
Kaze To Taiyo(凯泽・太阳)
;
Saga Occupational Health Association(Saga职业健康协会)
;
Department of Pharmacy, Zikei Hospital/Zikei Institute of Psychiatry(药剂科,Zikei医院/Zikei精神医学研究所)
;
Department of Medical Welfare, Suzuka University of Medical Science(医疗福祉科, Suzuka医科大学)
;
Graduate School of Human Sciences, Ritsumeikan University(人类科学研究生院,立命馆大学)
;
Faculty of Nursing, National Defense Medical College(护理学部,国家防卫医疗大学)
;
Support Center for Students with Disabilities, Aoyama Gakuin University(残疾学生支持中心,上智大学)