arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2408.06302cs.LGcs.CV
收藏

在歧义中寻找模式:决策边界中的可解释压力测试

Finding Patterns in Ambiguity: Interpretable Stress Testing in the Decision~Boundary

Inês Gomes, Luís F. Teixeira, Jan N. van Rijn, Carlos Soares, André Restivo, Luís Cunha, Moisés Santos

AI总结:

针对深度学习黑盒模型决策过程难理解的问题,提出从决策边界选取原型并结合模型后解释算法的方法,经2D可视化和GradientSHAP验证可捕捉低置信度决策特征,助力可靠ML系统的负责任开发。

摘要:

深度学习在各领域的应用日益广泛,凸显了理解这些黑盒模型决策过程的重要性。近期聚焦深度分类器决策边界的研究,依赖在低置信度区域生成的合成实例,发现了同时挑战模型和人类的样本。我们提出一种新方法,通过从决策边界中选取代表性样本——原型(prototypes),并应用模型后解释算法,来提升深度二分类器的可解释性。我们通过2D可视化和GradientSHAP分析评估了该方法的有效性。实验证明了所提方法的潜力,揭示了清晰紧凑的聚类以及能够捕捉导致低置信度决策核心特征的多样化原型。通过提供深度分类器决策边界的更聚合视图,我们的工作为可靠机器学习系统的负责任开发与部署做出了贡献。

英文摘要:

The increasing use of deep learning across various domains highlights the importance of understanding the decision-making processes of these black-box models. Recent research focusing on the decision boundaries of deep classifiers, relies on generated synthetic instances in areas of low confidence, uncovering samples that challenge both models and humans. We propose a novel approach to enhance the interpretability of deep binary classifiers by selecting representative samples from the decision boundary - prototypes - and applying post-model explanation algorithms. We evaluate the effectiveness of our approach through 2D visualizations and GradientSHAP analysis. Our experiments demonstrate the potential of the proposed method, revealing distinct and compact clusters and diverse prototypes that capture essential features that lead to low-confidence decisions. By offering a more aggregated view of deep classifiers' decision boundaries, our work contributes to the responsible development and deployment of reliable machine learning systems.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑