arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2106.07475cs.LGcs.AI
收藏

使用图像和文本分类研究显着图的健全性检查

Investigating sanity checks for saliency maps with image and text classification

Facebook AI(脸书人工智能研究院)

Narine Kokhlikyan, Vivek Miglani, Bilal Alsallakh, Miguel Martin, Orion Reblitz-Richardson

摘要:

显着图已被证明是有用的和误导的解释模型的预测,特别是在图像的背景下。在本文中,我们执行的文本模态的健全性检查,并表明图像的结论不直接转移到文本。我们还分析了输入乘数在某些显着性图中使用相似性分数,最大敏感度和不忠评估指标的影响。我们的观察表明,输入乘数进行输入的结构模式的解释地图,从而导致类似的结果,无论模型参数的选择。我们还表明,平滑的神经网络(NN)功能可以影响质量的显着性为基础的解释。我们的调查显示,用Softplus和MaxPool替换ReLU,并使用更平滑的变体(如LogSumExp(LSE)),可以导致基于不忠评估指标的更可靠的解释。

英文摘要:

Saliency maps have shown to be both useful and misleading for explaining model predictions especially in the context of images. In this paper, we perform sanity checks for text modality and show that the conclusions made for image do not directly transfer to text. We also analyze the effects of the input multiplier in certain saliency maps using similarity scores, max-sensitivity and infidelity evaluation metrics. Our observations reveal that the input multiplier carries input's structural patterns in explanation maps, thus leading to similar results regardless of the choice of model parameters. We also show that the smoothness of a Neural Network (NN) function can affect the quality of saliency-based explanations. Our investigations reveal that replacing ReLUs with Softplus and MaxPool with smoother variants such as LogSumExp (LSE) can lead to explanations that are more reliable based on the infidelity evaluation metric.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑