arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2501.09006cs.LG
收藏

通过替代搜索方法改进对抗性可解释人工智能中的稳定性估计

Improving Stability Estimates in Adversarial Explainable AI through Alternate Search Methods

University of Mississippi(密西西比大学)

Christopher Burger, Charles Walter

AI总结:

针对局部替代类可解释AI方法易受对抗攻击且现有研究未量化其脆弱程度的问题,提出用替代搜索方法找最小可行扰动,以更优地比较可解释性方法的稳定性。

摘要:

机器学习模型有效性的提升是以极高的复杂度为代价,导致人们对其运作方式的理解十分有限。局部替代方法一直被用于近似这些复杂模型的工作机制,但近期研究揭示了它们易受对抗攻击的脆弱性:在复杂模型输出的含义和结构保持相似的情况下,生成的解释却出现明显差异。此前的研究聚焦于这些弱点的存在性,却未关注其严重程度。本文探索使用一种替代搜索方法,目标是找到最小可行扰动——即让原始文本与修改后文本的解释达到固定相似度值所需的最少扰动数量。直观来看,要暴露特定程度的不稳定性所需扰动越少的方法,性能越差于所需扰动更多的方法。这种细微差别使得我们能更优地比较可解释性方法的稳定性。

英文摘要:

Advances in the effectiveness of machine learning models have come at the cost of enormous complexity resulting in a poor understanding of how they function. Local surrogate methods have been used to approximate the workings of these complex models, but recent work has revealed their vulnerability to adversarial attacks where the explanation produced is appreciably different while the meaning and structure of the complex model's output remains similar. This prior work has focused on the existence of these weaknesses but not on their magnitude. Here we explore using an alternate search method with the goal of finding minimum viable perturbations, the fewest perturbations necessary to achieve a fixed similarity value between the original and altered text's explanation. Intuitively, a method that requires fewer perturbations to expose a given level of instability is inferior to one which requires more. This nuance allows for superior comparisons of the stability of explainability methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑