arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2205.10232cs.LGcs.AI
收藏

基于多目标优化的反事实推理中可信度、变化强度和对抗力的权衡

Exploring the Trade-off between Plausibility, Change Intensity and Adversarial Power in Counterfactual Explanations using Multi-objective Optimization

TECNALIA, Basque Research and Technology Alliance (BRTA)(TECNALIA,巴斯克研究与技术联盟);University of the Basque Country (UPV/EHU)(巴斯克大学);University of Granada(格拉纳达大学);DaSCI Andalusian Institute of Data Science and Computational Intelligence(DaSCI安达卢西亚数据科学与计算智能研究所);Medical University of Graz(格拉茨医科大学);Alberta Machine Intelligence Institute(阿尔伯塔机器智能研究所);University of Alberta(阿尔伯塔大学)

Javier Del Ser, Alejandro Barredo-Arrieta, Natalia Díaz-Rodríguez, Francisco Herrera, Andreas Holzinger

摘要:

对于深度学习模型在涉及复杂数据的任务中的重要性,人们达成了广泛的共识。通常,在关注对人类至关重要的应用程序中的决策透明度时,需要充分理解这些模型。除了其他可解释性技术,可信度可以通过使用反事实来实现,就像人类熟悉未知过程的方式一样:通过理解输出变化的假设环境。在这项工作中,我们认为,自动反事实生成应该考虑几个方面的对抗性实例,而不仅仅是他们的对抗能力。为此,我们提出了一种新的框架,用于生成反事实示例,该框架将其目标制定为平衡三个不同目标的多目标优化问题:1)可扩展性,即,根据输入数据的分布,反事实的可能性; 2)原始输入的变化强度;以及3)对抗能力,即由反事实引起的模型输出的可变性。该框架从要审计的目标模型出发,并使用生成对抗网络来对输入数据的分布进行建模,以及用于发现这些目标之间的反事实平衡的多目标求解器。该框架的效用是展示了六个分类任务,包括图像和三维数据。实验证明,该框架揭示了符合直觉的反事实,增加了用户的可信度,并导致进一步的见解,如检测偏见和数据误报。

英文摘要:

There is a broad consensus on the importance of deep learning models in tasks involving complex data. Often, an adequate understanding of these models is required when focusing on the transparency of decisions in human-critical applications. Besides other explainability techniques, trustworthiness can be achieved by using counterfactuals, like the way a human becomes familiar with an unknown process: by understanding the hypothetical circumstances under which the output changes. In this work we argue that automated counterfactual generation should regard several aspects of the produced adversarial instances, not only their adversarial capability. To this end, we present a novel framework for the generation of counterfactual examples which formulates its goal as a multi-objective optimization problem balancing three different objectives: 1) plausibility, i.e., the likeliness of the counterfactual of being possible as per the distribution of the input data; 2) intensity of the changes to the original input; and 3) adversarial power, namely, the variability of the model's output induced by the counterfactual. The framework departs from a target model to be audited and uses a Generative Adversarial Network to model the distribution of input data, together with a multi-objective solver for the discovery of counterfactuals balancing among these objectives. The utility of the framework is showcased over six classification tasks comprising image and three-dimensional data. The experiments verify that the framework unveils counterfactuals that comply with intuition, increasing the trustworthiness of the user, and leading to further insights, such as the detection of bias and data misrepresentation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑