arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2406.03421cs.CV
收藏

事后部件原型网络

Post-hoc Part-prototype Networks

Hong Kong University of Science and Technology(香港科技大学);Center for Aging Science, HKUST(香港科技大学衰老科学中心)

Andong Tan, Fengtao Zhou, Hao Chen

AI总结:

针对现有事后解释方法无法说明模型寻找“什么”且部件原型网络准确率较低的问题,提出首个事后部件原型网络,通过无监督原型发现与精炼策略将已训练模型的分类头分解为可解释的部件原型,在保证模型性能的同时提供更忠实的解释。

摘要:

诸如Grad-CAM等事后可解释性方法很受欢迎,因为它们不会影响已训练模型的性能。然而,它们主要揭示模型对于给定输入“在哪里”看,却无法解释模型在寻找“什么”(例如,将鸟类图像分类为Scott Oriole的重要特征是什么?)。现有的部件原型网络利用部件原型(例如Scott Oriole特征性的翅膀和头部)来同时回答“在哪里”和“什么”,但在准确率上往往不如其黑盒对应模型。因此,一个自然的问题是:能否以事后方式构建一个同时回答“在哪里”和“什么”的网络,从而保证模型的性能?为此,我们提出了首个事后部件原型网络,通过将已训练模型的分类头分解为一组可解释的部件原型来实现。具体而言,我们提出了一种无监督的原型发现与精炼策略,以获得能够精确重建分类头且具有可解释性的原型。除了保证性能外,我们还表明,我们的网络在定性上提供了更忠实的解释,并在定量上产生了比先前部件原型网络更好的部件原型。

英文摘要:

Post-hoc explainability methods such as Grad-CAM are popular because they do not influence the performance of a trained model. However, they mainly reveal "where" a model looks at for a given input, fail to explain "what" the model looks for (e.g., what is important to classify a bird image to a Scott Oriole?). Existing part-prototype networks leverage part-prototypes (e.g., characteristic Scott Oriole's wing and head) to answer both "where" and "what", but often under-perform their black box counterparts in the accuracy. Therefore, a natural question is: can one construct a network that answers both "where" and "what" in a post-hoc manner to guarantee the model's performance? To this end, we propose the first post-hoc part-prototype network via decomposing the classification head of a trained model into a set of interpretable part-prototypes. Concretely, we propose an unsupervised prototype discovery and refining strategy to obtain prototypes that can precisely reconstruct the classification head, yet being interpretable. Besides guaranteeing the performance, we show that our network offers more faithful explanations qualitatively and yields even better part-prototypes quantitatively than prior part-prototype networks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑