arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2110.08429cs.CVcs.AI
收藏

TorchEsegeta:基于图像的深度学习模型的可解释性和可解释性框架

TorchEsegeta: Framework for Interpretability and Explainability of Image-based Deep Learning Models

Otto von Guericke University Magdeburg(马格德堡奥托·冯·格里克大学);German Center for Neurodegenerative Disease(德国神经退行性疾病中心);Center for Behavioral Brain Sciences(行为脑科学中心);Leibniz Institute for Neurobiology(莱布尼茨神经生物学研究所)

Soumick Chatterjee, Arnab Das, Chirag Mandal, Budhaditya Mukhopadhyay, Manish Vipinraj, Aniruddh Shukla, Rajatha Nagaraja Rao, Chompunuch Sarasaen, Oliver Speck, Andreas Nürnberger

摘要:

临床医生通常对在实践中应用自动图像处理方法,特别是基于深度学习的方法持怀疑态度。其中一个主要原因是这些方法的黑箱性质和自动导出决策的内在问题。为了增加对这些方法的信任,本文提出了一些方法,通过描述最影响算法决策的解剖区域,来帮助解释和解释深度学习算法的结果。此外,这项研究提出了一个统一的框架TorchEsegeta,用于为深度学习模型应用各种可解释性和可解释性技术,并为临床医生生成视觉解释和解释,以证实他们的临床发现。此外,这将有助于获得对这些方法的信心。该框架建立在现有的可解释性和可解释性技术的基础上,这些技术目前专注于分类模型,并将其扩展到分割任务。此外,这些方法已被改编为三维模型的体积分析。所提出的框架提供了方法来定量比较视觉解释使用不忠和敏感性指标。数据科学家可以使用这个框架对他们的模型进行事后解释和解释,开发更多可解释的工具,并将发现呈现给临床医生,以增加他们对这些模型的信心。所提出的框架进行了评估的基础上训练的时间的战斗(TOF)的人脑磁共振血管造影(MRA)图像的血管分割模型的用例场景。不同的模型和可解释性方法的比较研究的定量和定性结果。此外,本文提供了一个广泛的概述,现有的几个可解释性和可解释性的方法。

英文摘要:

Clinicians are often very sceptical about applying automatic image processing approaches, especially deep learning based methods, in practice. One main reason for this is the black-box nature of these approaches and the inherent problem of missing insights of the automatically derived decisions. In order to increase trust in these methods, this paper presents approaches that help to interpret and explain the results of deep learning algorithms by depicting the anatomical areas which influence the decision of the algorithm most. Moreover, this research presents a unified framework, TorchEsegeta, for applying various interpretability and explainability techniques for deep learning models and generate visual interpretations and explanations for clinicians to corroborate their clinical findings. In addition, this will aid in gaining confidence in such methods. The framework builds on existing interpretability and explainability techniques that are currently focusing on classification models, extending them to segmentation tasks. In addition, these methods have been adapted to 3D models for volumetric analysis. The proposed framework provides methods to quantitatively compare visual explanations using infidelity and sensitivity metrics. This framework can be used by data scientists to perform post-hoc interpretations and explanations of their models, develop more explainable tools and present the findings to clinicians to increase their faith in such models. The proposed framework was evaluated based on a use case scenario of vessel segmentation models trained on Time-of-fight (TOF) Magnetic Resonance Angiogram (MRA) images of the human brain. Quantitative and qualitative results of a comparative study of different models and interpretability methods are presented. Furthermore, this paper provides an extensive overview of several existing interpretability and explainability methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑