Current image-text evaluation often relies on a global score, which gives limited insight into which semantic details are supported by the image. Explainable metrics provide rationales, but the visual evidence supporting those rationales can still be difficult to verify. We introduce VisExMEM, a reference-free evaluator that decomposes captions into atomic claims, localizes visual evidence, verifies each claim, and averages claim-level support into a global score. Explanations use the same evidence and decisions. We train Qwen3.5-based 4B and 9B models on 100K samples with multi-task SFT, counterfactual refinement, and evidence-aware GDPO. Across eight benchmarks, VisExMEM-9B achieves the highest descriptive composite among open-source evaluators in our comparison, exceeding VQAScore by 11.7 points while remaining competitive with GPT-5.6 Sol. We also introduce AGITA-Bench, containing 600 human-annotated image-text pairs and 8.7K atomic claims for global and claim-level evaluation. For untuned Qwen3.5 and GPT-5.6 Sol controls, decomposed prompting raises the same composite by 3.6-5.1 points relative to holistic prompting. Human evaluation shows that VisExMEM explanations outperform prior explainable metrics and approach GPT-5.6 Sol.
UkrMeme: Multimodal Explainable Persuasion Detection in Ukrainian Memes
Ukrainian Catholic University(乌克兰天主教大学);Johannes Gutenberg University Mainz(美因茨约翰内斯·古滕贝格大学);German Research Center for Artificial Intelligence (DFKI)(德国人工智能研究中心);Centre for European Research in Trusted AI (CERTAIN)(欧洲可信人工智能研究中心)
FLEUR: An Explainable Reference-Free Evaluation Metric for Image Captioning Using a Large Multimodal Model
Seoul National University(首尔大学);Interdisciplinary Program in Artificial Intelligence, Seoul National University(首尔大学人工智能跨学科项目);Department of Mathematical Sciences, Seoul National University(首尔大学数学科学系)
Multimodal Doctor-in-the-Loop: A Clinically-Guided Explainable Framework for Predicting Pathological Response in Non-Small Cell Lung Cancer
Research Unit of Computer Systems and Bioinformatics, Department of Engineering(计算机系统与生物信息学研究单位,工程系);Research Unit of Radiation Oncology, Department of Medicine and Surgery(放射肿瘤学研究单位,医学与外科系);Research Unit of Anatomical Pathology, Department of Medicine and Surgery(病理学研究单位,医学与外科系)
Fusing Perceptual Vision Experts with Multimodal LLMs for Explainable Plant Disease Diagnosis: From Benchmark Imagery to Real-World Robotic Field Validation
Cornell University(康奈尔大学);University of the Peloponnese(伯罗奔尼撒大学);Agricultural University of Athens(雅典农业大学)
EDVD-LLaMA: Explainable Deepfake Video Detection via Multimodal Large Language Model Reasoning
Department of Electrical and Electronic Engineering, The Hong Kong Polytechnic University(电子与电气工程系,香港理工大学);School of Electrical and Electronic Engineering, Nanyang Technological University(电子与电气工程学院,南洋理工大学);Shien-Ming Wu School of Intelligent Engineering, South China University of Technology(智能工程学院,华南理工大学)
XAI-CLIP: ROI-Guided Perturbation Framework for Explainable Medical Image Segmentation in Multimodal Vision-Language Models
King Fahd University of Petroleum and Minerals(国王法赫德石油和矿物大学);Massachusetts Institute of Technology(麻省理工学院);Imperial College London(伦敦帝国学院);KFUPM-SDAIA Joint Research Centre for Artificial Intelligence(KFUPM-SDAIA联合人工智能研究中心)
XEmoGPT: An Explainable Multimodal Emotion Recognition Framework with Cue-Level Perception and Reasoning
School of Computer Science and Engineering, University of Electronic Science and Technology of China(电子科技大学计算机科学与工程学院);th Research Institute, China Electronics Technology Group Corporation(中国电子科技集团第五十四研究所)
Bridging the gap between Performance and Interpretability: An Explainable Disentangled Multimodal Framework for Cancer Survival Prediction
AI Technology for Life(人工智能技术与生命科学);Department of Information and Computing Sciences(信息与计算科学系);Department of Biology(生物学系);Utrecht University(乌得勒支大学);Department of Metabolic Diseases(代谢疾病部门);Wilhelmina Children’s Hospital(维廉明娜儿童医院);University Medical Center Utrecht(乌得勒支大学医学中心);Regenerative Medicine Center Utrecht(乌得勒支再生医学中心);Computational Pathology(计算病理学);Department of Pathology(病理学系);The Netherlands Cancer Institute(荷兰癌症研究所);Visualization and Graphics(可视化与图形学);The Netherlands Cancer Institute, Amsterdam(荷兰癌症研究所,阿姆斯特丹)
REMEMBER: Retrieval-based Explainable Multimodal Evidence-guided Modeling for Brain Evaluation and Reasoning in Zero- and Few-shot Neurodegenerative Diagnosis
Lausanne University Hospital (CHUV)(洛桑大学医院(CHUV));University of Lausanne (UNIL)(洛桑大学(UNIL));Vietnam National University(越南国立大学);University of Science, Vietnam National University Ho Chi Minh City(越南国立大学胡志明市科学大学);International University, Vietnam National University Ho Chi Minh City(越南国立大学胡志明市国际大学)
MARE: Multimodal Alignment and Reinforcement for Explainable Deepfake Detection via Vision-Language Models
School of Computer Science and Engineering, MoE Key Laboratory of Information Technology, Guangdong Province Key Laboratory of Information Security Technology, Sun Yat-sen University, Guangzhou 510006, China(计算机科学与工程学院,信息技术MOE实验室,广东省信息安全技术重点实验室,中山大学,广州510006,中国);State Key Laboratory of Mathematical Engineering and Advanced Computing(数学工程与先进计算国家重点实验室);Department of Computer and Information Science, University of Macau.(计算机与信息科学系,澳门大学)
Towards Explainable Bilingual Multimodal Misinformation Detection and Localization
University of Liverpool, United Kingdom(利物浦大学);National University of Singapore, Singapore(新加坡国立大学);The Chinese University of Hong Kong, Shenzhen, China(香港中文大学(深圳))
Explainable Multimodal Deep Learning Integrating Imaging and Clinical Data for Oral Potentially Malignant Disorder Detection
Wyant College of Optical Sciences, University of Arizona(亚利桑那大学怀恩特光学科学学院);Beckman Laser Institute & Medical Clinic, University of California Irvine(加州大学尔湾分校贝克曼激光研究所与医学诊所)
Transformer-Driven Multimodal Fusion for Explainable Suspiciousness Estimation in Visual Surveillance
Big Data Research and Supercomputing Division, CSIR Fourth Paradigm Institute(CSIR第四范式研究所大数据研究与超级计算部门);Department of Electrical Engineering, Bharti School of Telecommunication, Yardi School of Artificial Intelligence, IIT Delhi(电信学院电子工程系、Yardi人工智能学院、德里理工学院)
A Multimodal Explainable Deep Learning Framework for Alzheimer's Disease Diagnosis using 3D Magnetic Resonance Imaging and Clinical Data
Osnabrück University(奥斯纳布吕克大学);Rhodes University(罗德斯大学);National Institute for Theoretical and Computational Sciences (NITheCS)(国家理论与计算科学研究所);Madanapalle Institute of Technology and Science(马达纳帕莱理工学院);Université Clermont Auvergne(克莱蒙奥弗涅大学)
AIGI-Holmes: Towards Explainable and Generalizable AI-Generated Image Detection via Multimodal Large Language Models
Key Laboratory of Multimedia Trusted Perception and Efficient Computing, Ministry of Education of China, Xiamen University(中国教育部多媒体可信感知与高效计算重点实验室,厦门大学);Tencent YouTu Lab(腾讯YouTu实验室)
High Accurate and Explainable Multi-Pill Detection Framework with Graph Neural Network-Assisted Multimodal Data Fusion
VinUni-Illinois Smart Health Center(文大-伊利诺伊智能健康中心);VinUniversity(文大);École Polytechnique Fédérale de Lausanne(洛桑联邦理工学院);Griffith University(格里菲斯大学);Hanoi University of Science and Technology(河内理工大学)
VisTA: Vision-Text Alignment Model with Contrastive Learning using Multimodal Data for Evidence-Driven, Reliable, and Explainable Alzheimer's Disease Diagnosis
Centre hospitalier universitaire vaudois (CHUV)(洛桑大学医院中心(CHUV));Université de Lausanne (UNIL)(洛桑大学(UNIL));VNU University of Engineering and Technology, Vietnam National University(越南国家大学下属越南工程技术大学);University of Science, Vietnam National University Ho Chi Minh City(胡志明市越南国家大学下属科学大学);Military Hospital 175(175军事医院);School of Biomedical Engineering, International University, Vietnam National University(越南国家大学下属国际大学生物医学工程学院)