arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2406.05090cs.LGcs.AIcs.CV
收藏

通过特征归因的优化聚合实现可证明更优的解释

Provably Better Explanations with Optimized Aggregation of Feature Attributions

LMU Munich(慕尼黑大学);Siemens AG(西门子公司);Technical University of Munich(慕尼黑工业大学);University of Oxford(牛津大学);Munich Center for Machine Learning (MCML)(慕尼黑机器学习中心);German Cancer Research Center (DKFZ)(德国癌症研究中心);Goethe University Frankfurt(法兰克福大学)

Thomas Decker, Ananta R. Bhattarai, Jindong Gu, Volker Tresp, Florian Buettner

AI总结:

本文提出通过最优凸组合聚合多个特征归因方法,以可证明的方式提升解释的鲁棒性和忠实度,并在多种模型与归因技术上验证其优于单个方法及现有基线。

摘要:

使用特征归因进行事后解释是理解和验证不透明机器学习模型预测的常见做法。尽管已有众多技术可用,但单个方法往往产生不一致且不稳定的结果,使其整体可靠性受到质疑。在本工作中,我们旨在通过组合不同方法或其变体的多个解释来系统性地提升特征归因的质量。为此,我们提出一种新方法,用于推导特征归因的最优凸组合,从而在鲁棒性或对模型行为的忠实度等期望质量准则上获得可证明的改进。通过在多种模型架构和流行特征归因技术上开展的大量实验,我们证明所提出的组合策略始终优于单个方法和现有基线。

英文摘要:

Using feature attributions for post-hoc explanations is a common practice to understand and verify the predictions of opaque machine learning models. Despite the numerous techniques available, individual methods often produce inconsistent and unstable results, putting their overall reliability into question. In this work, we aim to systematically improve the quality of feature attributions by combining multiple explanations across distinct methods or their variations. For this purpose, we propose a novel approach to derive optimal convex combinations of feature attributions that yield provable improvements of desired quality criteria such as robustness or faithfulness to the model behavior. Through extensive experiments involving various model architectures and popular feature attribution techniques, we demonstrate that our combination strategy consistently outperforms individual methods and existing baselines.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑