Perceive and Calibrate: Analyzing and Enhancing Robustness of Medical Multi-Modal Large Language Models
感知与校准:分析和增强医疗多模态大语言模型的鲁棒性
机构 * Department of Computer Science and Engineering, CUHK, Hong Kong, China(计算机科学与工程系,CUHK,香港,中国) ; Institute of Medical Intelligence and XR, CUHK, Hong Kong, China(医学智能与XR研究所,CUHK,香港,中国)
专题命中 多模态评测 :multi-modal(title,abstract);cross-modal(abstract);分类 cs.CV
AI总结 本文提出IMC框架,通过感知和校准原则提升医疗多模态大语言模型的鲁棒性,针对视觉和文本模态分别设计PDC和SMS进行噪声校正。