arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2509.16567cs.CVcs.AI

V-CECE:通过概念编辑生成视觉反事实解释

V-CECE: Visual Counterfactual Explanations via Conceptual Edits

National Technical University of Athens(国家技术大学雅典)

Nikolaos Spanos, Maria Lymperaiou, Giorgos Filandrianos, Konstantinos Thomas, Athanasios Voulodimos, Giorgos Stamou

AI总结:

V-CECE通过概念编辑生成反事实解释,无需训练即可产生人类水平的可解释性结果。

摘要:

最近的黑盒反事实生成框架未能考虑所提出编辑的语义内容,而主要依赖训练来指导生成过程。我们提出了一种新颖的、即插即用的黑盒反事实生成框架,该框架基于最优编辑的理论保证,逐步提出编辑以生成具有零训练的人类水平反事实解释。我们的框架利用预训练的图像编辑扩散模型,并且不访问分类器的内部,导致可解释的反事实生成过程。在整个实验过程中,我们通过使用卷积神经网络(CNN)、视觉变换器(ViT)和大视觉语言模型(LVLM)分类器,展示了人类推理与神经模型行为之间的解释差距,并通过全面的人类评估加以验证。

英文摘要:

Recent black-box counterfactual generation frameworks fail to take into account the semantic content of the proposed edits, while relying heavily on training to guide the generation process. We propose a novel, plug-and-play black-box counterfactual generation framework, which suggests step-by-step edits based on theoretical guarantees of optimal edits to produce human-level counterfactual explanations with zero training. Our framework utilizes a pre-trained image editing diffusion model, and operates without access to the internals of the classifier, leading to an explainable counterfactual generation process. Throughout our experimentation, we showcase the explanatory gap between human reasoning and neural model behavior by utilizing both Convolutional Neural Network (CNN), Vision Transformer (ViT) and Large Vision Language Model (LVLM) classifiers, substantiated through a comprehensive human evaluation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑