arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2006.09994cs.CVcs.LG
收藏

噪声还是信号:图像背景在物体识别中的作用

Noise or Signal: The Role of Image Backgrounds in Object Recognition

MIT(麻省理工学院)

Kai Xiao, Logan Engstrom, Andrew Ilyas, Aleksander Madry

摘要:

我们评估了最先进的对象识别模型依赖于图像背景信号的趋势。我们创建了一个工具包,用于在ImageNet图像上解开前景和背景信号,并发现(a)模型可以通过单独依赖背景来实现非平凡的准确性,(b)即使在存在正确分类的前景的情况下,模型也经常对图像进行错误分类-高达87.5%的时间选择了相反的背景,我们对背景的分析使我们更接近于理解机器学习模型使用哪些相关性,以及它们如何确定模型的分布性能。

英文摘要:

We assess the tendency of state-of-the-art object recognition models to depend on signals from image backgrounds. We create a toolkit for disentangling foreground and background signal on ImageNet images, and find that (a) models can achieve non-trivial accuracy by relying on the background alone, (b) models often misclassify images even in the presence of correctly classified foregrounds--up to 87.5% of the time with adversarially chosen backgrounds, and (c) more accurate models tend to depend on backgrounds less. Our analysis of backgrounds brings us closer to understanding which correlations machine learning models use, and how they determine models' out of distribution performance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑