As AI-based medical devices are becoming more common in imaging fields like radiology and histology, interpretability of the underlying predictive models is crucial to expand their use in clinical practice. Existing heatmap-based interpretability methods such as GradCAM only highlight the location of predictive features but do not explain how they contribute to the prediction. In this paper, we propose a new interpretability method that can be used to understand the predictions of any black-box model on images, by showing how the input image would be modified in order to produce different predictions. A StyleGAN is trained on medical images to provide a mapping between latent vectors and images. Our method identifies the optimal direction in the latent space to create a change in the model prediction. By shifting the latent representation of an input image along this direction, we can produce a series of new synthetic images with changed predictions. We validate our approach on histology and radiology images, and demonstrate its ability to provide meaningful explanations that are more informative than GradCAM heatmaps. Our method reveals the patterns learned by the model, which allows clinicians to build trust in the model's predictions, discover new biomarkers and eventually reveal potential biases.
Brain Tumor Synthetic Data Generation with Adaptive StyleGANs
National University of Computer and Emerging Sciences（国立计算机与新兴科学大学）；MD ANDERSON Cancer Center, The University of Texas（德克萨斯大学MD安德森癌症中心）；Hamad Bin Khalifa University（哈马德·本·哈利法大学）
3D-StyleGAN: A Style-Based Generative Adversarial Network for Generative Modeling of Three-Dimensional Medical Images
Massachusetts General Hospital（麻省总医院）；Harvard Medical School（哈佛医学院）；Massachusetts Institute of Technology（麻省理工学院）；Univ. Lille（里尔大学）；Inserm（法国国家健康与医学研究院）；CHU Lille（里尔大学医院）
Towards Data-Efficient Medical Imaging: A Generative and Semi-Supervised Framework
Dept. of Electrical and Electronic Engineering Imperial College London（电气与电子工程系帝国理工学院伦敦）；Centre for Vision, Speech and Signal Processing University of Surrey（视觉、语音和信号处理中心萨里大学）
Enhancing Multimodal Medical Image Classification using Cross-Graph Modal Contrastive Learning
Department of Systems Engineering, Stevens Institute of Technology, Hoboken, New Jersey, USA（系统工程系，史蒂文斯理工学院）；Department of Nuclear Medicine, Kaohsiung Chang Gung Memorial Hospital, Kaohsiung, Taiwan（高雄长庚纪念医院核医学部）；Institute of Statistics, National University of Kaohsiung, Kaohsiung, Taiwan（国立高雄大学统计研究所）；Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China（深圳先进技术研究院，中国科学院）
Towards Multi-dimensional Explanation Alignment for Medical Classification
King Abdullah University of Science and Technology（阿卜杜拉国王科技大学）；HKUST(GZ)（香港科技大学（广州））；Tongji University（同济大学）；Ant Group（蚂蚁集团）；The University of Auckland（奥克兰大学）；RIKEN Center for Advanced Intelligence Project (AIP)（理化学研究所先进智能项目中心）
Learning Concept-Driven Logical Rules for Interpretable and Generalizable Medical Image Classification
School of Data Science, Fudan University（复旦大学数据科学学院）；Dept. of Computer Science and Engineering, The Chinese University of Hong Kong（香港中文大学计算机科学与工程系）；Dept. of Oncology, University of Cambridge（剑桥大学肿瘤学系）
When Differential Privacy Meets Interpretability: A Case Study
Manipal Institute of Technology（马尼帕尔理工学院）；Carnegie Mellon University（卡内基梅隆大学）；OpenMined；University of Pennsylvania（宾夕法尼亚大学）；IIT Jodhpur（印度理工学院焦特布尔分校）；University of California, San Diego（加州大学圣地亚哥分校）
RadImageGAN -- A Multi-modal Dataset-Scale Generative AI for Medical Imaging
BioMedical Engineering and Imaging Institute, Icahn School of Medicine at Mount Sinai（西奈山伊坎医学院生物医学工程与影像研究所）；NVIDIA（英伟达公司）；East River Medical Imaging（东河医学影像机构）；Cornell Medicine（康奈尔医学院）
Iterative Augmentation of Visual Evidence for Weakly-Supervised Lesion Localization in Deep Interpretability Frameworks: Application to Color Fundus Images
Interpretability-guided Data Augmentation for Robust Segmentation in Multi-centre Colonoscopy Data
The Netherlands Cancer Institute（荷兰癌症研究所）；GROW School for Oncology and Developmental Biology, Maastricht University Medical Center（马斯特里赫特大学医学中心GROW肿瘤与发育生物学学院）
Comparing radiologists' gaze and saliency maps generated by interpretability methods for chest x-rays
Scientific Computing and Imaging Institute, University of Utah（犹他大学科学计算与成像研究所）；School of Computing, University of Utah（犹他大学计算学院）；Department of Psychology, University of Utah（犹他大学心理学系）；Department of Radiology and Imaging Sciences, University of Utah（犹他大学放射学与影像科学系）
MedicalPatchNet: A Patch-Based Self-Explainable AI Architecture for Chest X-ray Classification
Department of Diagnostic and Interventional Radiology of the University Hospital RWTH Aachen（鲁尔大学亚琛医院诊断与介入放射科）；Else Kroener Fresenius Center for Digital Health, Technical University Dresden（德累斯顿技术大学埃勒克罗纳弗雷斯内尔数字健康中心）；Department of Medicine III, University Hospital RWTH Aachen（鲁尔大学亚琛医院第三医学部）；Pathology & Data Analytics, Leeds Institute of Medical Research at St James’s, University of Leeds（利兹大学圣詹姆斯医院医学研究所以及病理学与数据科学）；Department of Medicine I, University Hospital Dresden（德累斯顿大学第一医学部）；Medical Oncology, National Center for Tumor Diseases (NCT), University Hospital Heidelberg（海德堡大学国家肿瘤疾病中心（NCT）肿瘤医学部）
GFSR-Net: Guided Focus via Segment-Wise Relevance Network for Interpretable Deep Learning in Medical Imaging
Institute of Physical Chemistry (IPC) and Abbe Center of Photonics (ACP), Friedrich Schiller University Jena（耶拿弗里德里希·席勒大学物理化学研究所与阿贝光子学中心）；Leibniz Institute of Photonic Technology（莱布尼茨光子技术研究所）
GenMix: Combining Generative and Mixture Data Augmentation for Medical Image Classification
School of Electrical Engineering（电气工程学院）；Korea Advanced Institute of Science and Technology（韩国科学技术院）；Department of Software Convergence（软件融合系）；Seoul Women’s University（首尔女子大学）
Counterfactual Explanations for Medical Image Classification and Regression using Diffusion Autoencoder
Technical University of Munich（慕尼黑工业大学）；Klinikum rechts der Isar（右侧伊萨尔医院）；Institute for Artificial Intelligence and Computer Science in Medicine, Technical University of Munich（慕尼黑工业大学人工智能与医学计算机科学研究所）；Computer Aided Medical Procedures, Technical University of Munich（慕尼黑工业大学计算机辅助医疗程序研究所）；AI for Image-Guided Diagnosis and Therapy, Technical University of Munich（慕尼黑工业大学图像引导诊断与治疗人工智能研究所）
Exploration of Interpretability Techniques for Deep COVID-19 Classification using Chest X-ray Images
Otto von Guericke University Magdeburg（马格德堡奥托·冯·格里克大学）；University of Barcelona（巴塞罗那大学）；Universitätsklinikum Erlangen（埃尔兰根大学医院）；Apollo Hospitals（阿波罗医院）；HCG Cancer Centre（HCG癌症中心）；Computer Vision Centre（计算机视觉中心）
NeRD: Neuro-Symbolic Rule Distillation for Efficient Ontology-Grounded Chain-of-Thought in Medical Image Diagnosis
Department of Data Science & AI, Faculty of Information Technology, Monash University（莫纳什大学信息技术学院数据科学与人工智能系）；AIM for Health Lab, Faculty of Information Technology, Monash University（莫纳什大学信息技术学院AIM健康实验室）；Faculty of Engineering, Monash University（莫纳什大学工程学院）；Faculty of Medicine, The Chinese University of Hong Kong（香港中文大学医学院）；School of Computing Technologies, RMIT University（皇家墨尔本理工大学计算技术学院）
Clinical Interpretability of Deep Learning Segmentation Through Shapley-Derived Agreement and Uncertainty Metrics
Department of Mechanical Engineering, University of Washington（华盛顿大学机械工程系）；University of Washington School of Medicine（华盛顿大学医学院）；Department of Neurological Surgery, University of Washington（华盛顿大学神经外科系）
On Interpretability of Deep Learning based Skin Lesion Classifiers using Concept Activation Vectors
Hochschule Pforzheim（普福尔茨海姆应用技术大学）；Smart Data and Knowledge Services German Research Center for Artificial Intelligence GmbH (DFKI)（德国人工智能研究中心智能数据与知识服务部）；Technische Universität Kaiserslautern（凯泽斯劳滕工业大学）；Universitätsklinikum Münster（明斯特大学医院）；Universitätsklinikum Düsseldorf（杜塞尔多夫大学医院）；National University of Science and Technology (NUST)（巴基斯坦国立科技大学）；National Center of Artificial Intelligence（国家人工智能中心）
Learning to Select Like Humans: Explainable Active Learning for Medical Imaging
AI Research, Department of Computer Science, University of South Dakota（人工智能研究，计算机科学系，南达科他大学）；Department of Computer Science and Software Engineering, Auburn University（计算机科学与软件工程系，阿伯丁大学）
