To equip Convolutional Neural Networks (CNNs) with explainability, it is essential to interpret how opaque models take specific decisions, understand what causes the errors, improve the architecture design, and identify unethical biases in the classifiers. This paper introduces ADVISE, a new explainability method that quantifies and leverages the relevance of each unit of the feature map to provide better visual explanations. To this end, we propose using adaptive bandwidth kernel density estimation to assign a relevance score to each unit of the feature map with respect to the predicted class. We also propose an evaluation protocol to quantitatively assess the visual explainability of CNN models. We extensively evaluate our idea in the image classification task using AlexNet, VGG16, ResNet50, and Xception pretrained on ImageNet. We compare ADVISE with the state-of-the-art visual explainable methods and show that the proposed method outperforms competing approaches in quantifying feature-relevance and visual explainability while maintaining competitive time complexity. Our experiments further show that ADVISE fulfils the sensitivity and implementation independence axioms while passing the sanity checks. The implementation is accessible for reproducibility purposes on https://github.com/dehshibi/ADVISE.
Methodological Explainability Evaluation of an Interpretable Deep Learning Model for Post-Hepatectomy Liver Failure Prediction Incorporating Counterfactual Explanations and Layerwise Relevance Propagation: A Prospective In Silico Trial
Maastricht University(马斯特里赫特大学);Maastricht University Medical Center+(马斯特里赫特大学医学中心+);The First Affiliated Hospital of Sun Yat-sen University(中山大学附属第一医院);Guizhou University(贵州大学);Université Libre de Bruxelles(布鲁塞尔自由大学)
Concept-based explanation of gene expression prediction from H&E images
Institute of Pathology – Charité Universitätsmedizin(夏里特医学院病理学研究所);Fraunhofer Heinrich-Hertz-Institute(弗劳恩霍夫海因里希·赫兹研究所);Center for Computational Biology (CBIO), Mines Paris, PSL University(巴黎矿业学院计算生物学中心(巴黎文理研究大学));Institut Curie, PSL University(居里研究所(巴黎文理研究大学));German Cancer Research Center (DKFZ)(德国癌症研究中心);Technological University Dublin(都柏林理工大学);Technische Universität Berlin(柏林工业大学);BIFOLD – Berlin Institute for the Foundations of Learning and Data(柏林学习与数据基础研究所)