MPIB: A Benchmark for Medical Prompt Injection Attacks and Clinical Safety in LLMs
Seoul National University College of Medicine(首尔国立大学医学院);Seoul National University(首尔国立大学);Seoul National University College of Medicine, Seoul National University Hospital(首尔国立大学医学院、首尔国立大学医院)
Junhyeok Lee, Han Jang, Kyu Sung Choi
备注:
19 pages, 7 figures, 18 tables. Accepted to Findings of EMNLP 2026
Large Language Models (LLMs) and Retrieval-Augmented Generation (RAG) systems are increasingly integrated into clinical workflows. However, prompt injection attacks can steer these systems toward clinically unsafe or misleading outputs. We introduce the Medical Prompt Injection Benchmark (MPIB), a dataset-and-benchmark suite for evaluating clinical safety under both direct prompt injection and indirect, RAG-mediated injection across clinically grounded tasks. MPIB emphasizes outcome-level risk via the Clinical Harm Event Rate (CHER), which measures high-severity clinical harm events under a clinically grounded taxonomy, and reports CHER alongside ASR$_2$ to distinguish moderate-or-worse from high-severity outcomes. The benchmark comprises 9,697 curated instances constructed through multi-stage quality gates and clinical safety linting. Evaluating MPIB across a diverse set of baseline LLMs and defense configurations, we find that ASR$_2$ and CHER$_3$ can diverge substantially, and that observed rates vary depending on whether adversarial instructions appear in the user query or in retrieved context. The MPIB dataset and evaluation code are available on Hugging Face and GitHub, respectively.
Question-Answering System Extracts Information on Injection Drug Use from Clinical Notes
Oak Ridge National Laboratory(橡树岭国家实验室);Vanderbilt University(范德堡大学);Department of Veterans Affairs(美国退伍军人事务部);Stanford University School of Medicine(斯坦福大学医学院);Veterans Affairs Great Lakes Health Care System(退伍军人事务部大湖区医疗系统)
MIND: Unified Inquiry and Diagnosis RL with Criteria Grounded Clinical Supports for Psychiatric Consultation
EverMind AI Inc.(EverMind AI公司);EverMind AI Inc., Tianqiao and Chrissy Chen Institute(EverMind AI公司、田桥与克里斯西·陈研究所);Shanghai Mental Health Center, Shanghai Jiao Tong University School of Medicine(上海精神卫生中心、上海交通大学医学院)
A Hybrid Machine Learning Approach for Synthetic Data Generation with Post Hoc Calibration for Clinical Tabular Datasets
organization= Department of Electrical \& Electronic Engineering, Bangladesh University of Business;organization= Department of Electrical Engineering;Computer Science, University of Michigan , country= United States
Clinical NLP with Attention-Based Deep Learning for Multi-Disease Prediction
University of Massachusetts Boston(马萨诸塞大学波士顿分校);DePaul University(德保罗大学);University of California, Davis(加利福尼亚大学戴维斯分校);Northeastern University(东北大学);University of Delaware(特拉华大学)
RADAR: Enhancing Radiology Report Generation with Supplementary Knowledge Injection
Department of Computing, The Hong Kong Polytechnic University(香港理工大学计算机系);Research Institute of Trustworthy Autonomous Systems and Department of Computer Science and Engineering, Southern University of Science and Technology(南方科技大学可信自主系统研究院和计算机科学与工程系);School of Computer Science, University of Nottingham Ningbo China(宁波大学计算机学院)