arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2303.12641cs.CVcs.AI
收藏

Reveal to Revise:一个可解释的深度模型迭代偏差修正的AI生存周期

Reveal to Revise: An Explainable AI Life Cycle for Iterative Bias Correction of Deep Models

Fraunhofer Heinrich-Hertz-Institute(弗劳恩霍夫海因里希·赫兹研究所);Technische Universität Berlin(柏林工业大学);BIFOLD – Berlin Institute for the Foundations of Learning and Data(BIFOLD——柏林学习与数据基础研究所)

Frederik Pahde, Maximilian Dreyer, Wojciech Samek, Sebastian Lapuschkin

摘要:

最先进的机器学习模型经常学习嵌入在训练数据中的虚假相关性。这在部署这些模型进行高风险决策时带来了风险,例如在皮肤癌检测等医疗应用中。为了解决这个问题,我们提出了Reveal to Revise(R2R),这是一个包含整个可解释人工智能(XAI)生存周期的框架,使从业者能够迭代地识别,缓解和(重新)评估虚假的模型行为,只需最少的人工交互。在第一步(1)中,R2R通过发现属性中的离群值或通过检查模型学习的潜在概念来揭示模型的弱点。其次(2),在输入数据中检测并空间定位负责的伪影,然后利用该伪影来(3)修正模型行为。具体地说,我们应用RRR、CDEP和ClArC方法进行模型校正,(4)重新评估模型的性能和对伪影的剩余敏感性。使用两个用于黑色素瘤检测和骨龄估计的医学基准数据集,我们将我们的R2R框架应用于VGG,ResNet和EfficientNet架构,从而揭示和纠正真实的黑色素瘤内在伪影,以及受控环境中的合成变体。在完成XAI生存周期后,我们演示了多个R2R迭代以减轻不同的偏倚。代码可在https://github.com/maxdreyer/Reveal2Revise上获得。

英文摘要:

State-of-the-art machine learning models often learn spurious correlations embedded in the training data. This poses risks when deploying these models for high-stake decision-making, such as in medical applications like skin cancer detection. To tackle this problem, we propose Reveal to Revise (R2R), a framework entailing the entire eXplainable Artificial Intelligence (XAI) life cycle, enabling practitioners to iteratively identify, mitigate, and (re-)evaluate spurious model behavior with a minimal amount of human interaction. In the first step (1), R2R reveals model weaknesses by finding outliers in attributions or through inspection of latent concepts learned by the model. Secondly (2), the responsible artifacts are detected and spatially localized in the input data, which is then leveraged to (3) revise the model behavior. Concretely, we apply the methods of RRR, CDEP and ClArC for model correction, and (4) (re-)evaluate the model's performance and remaining sensitivity towards the artifact. Using two medical benchmark datasets for Melanoma detection and bone age estimation, we apply our R2R framework to VGG, ResNet and EfficientNet architectures and thereby reveal and correct real dataset-intrinsic artifacts, as well as synthetic variants in a controlled setting. Completing the XAI life cycle, we demonstrate multiple R2R iterations to mitigate different biases. Code is available on https://github.com/maxdreyer/Reveal2Revise.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑