Debiased-CAM通过对机器学习的忠实视觉解释来减轻系统误差
Debiased-CAM to mitigate systematic error with faithful visual explanations of machine learning
摘要:
模型解释(如显着性图)可以通过突出预测的重要特征来提高用户对AI的信任。然而,当解释受系统误差(偏差)影响的图像预测时,这些会变得扭曲和误导。此外,尽管模型对受不同因素(模糊、色温、白天/夜晚)影响的图像进行了微调,但失真仍然存在。我们提出Debiased-CAM通过训练多输入,多任务模型,辅助任务的解释和偏见水平预测,以恢复各种偏见类型和水平的解释忠诚度。在模拟研究中,该方法不仅提高了预测精度,而且还生成了关于这些预测的高度可信的解释,就好像图像是无偏的一样。在用户研究中,去偏见的解释提高了用户的任务绩效,感知真实性和感知有用性。去偏训练可以为具有数据偏差的广泛应用提供一个多功能平台,以实现强大的性能和解释忠实性。
英文摘要:
Model explanations such as saliency maps can improve user trust in AI by highlighting important features for a prediction. However, these become distorted and misleading when explaining predictions of images that are subject to systematic error (bias). Furthermore, the distortions persist despite model fine-tuning on images biased by different factors (blur, color temperature, day/night). We present Debiased-CAM to recover explanation faithfulness across various bias types and levels by training a multi-input, multi-task model with auxiliary tasks for explanation and bias level predictions. In simulation studies, the approach not only enhanced prediction accuracy, but also generated highly faithful explanations about these predictions as if the images were unbiased. In user studies, debiased explanations improved user task performance, perceived truthfulness and perceived helpfulness. Debiased training can provide a versatile platform for robust performance and explanation faithfulness for a wide range of applications with data biases.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。