arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2106.12303cs.CV
收藏

基于学习空间结构的分类模型鲁棒性估计

Estimating the Robustness of Classification Models by the Structure of the Learned Feature-Space

Fraunhofer ITWM(弗劳恩霍夫工业数学研究所);Offenburg University(奥芬堡应用科学大学);University of Mannheim(曼海姆大学)

Kalun Ho, Franz-Josef Pfreundt, Janis Keuper, Margret Keuper

摘要:

在过去的十年中,深度图像分类网络的发展主要是通过在ImageNet等标准化基准上寻找分类准确性方面的最佳性能来推动的。最近,这一焦点已经被模型鲁棒性的概念所扩展,\ie模型对数据分布中以前看不见的变化的泛化能力。虽然新的基准测试,如ImageNet-C,已经被引入来衡量鲁棒性,我们认为,固定的测试集只能捕获一小部分可能的数据变化,因此是有限的,容易产生新的过拟合的解决方案。为了克服这些缺点,我们建议直接从学习的特征空间的结构来估计模型的鲁棒性。我们引入了鲁棒性指标,这些指标是通过对来自训练分类器的潜在表示进行无监督聚类而获得的,并且在损坏的测试数据上与模型性能表现出非常高的相关性。

英文摘要:

Over the last decade, the development of deep image classification networks has mostly been driven by the search for the best performance in terms of classification accuracy on standardized benchmarks like ImageNet. More recently, this focus has been expanded by the notion of model robustness, \ie the generalization abilities of models towards previously unseen changes in the data distribution. While new benchmarks, like ImageNet-C, have been introduced to measure robustness properties, we argue that fixed testsets are only able to capture a small portion of possible data variations and are thus limited and prone to generate new overfitted solutions. To overcome these drawbacks, we suggest to estimate the robustness of a model directly from the structure of its learned feature-space. We introduce robustness indicators which are obtained via unsupervised clustering of latent representations from a trained classifier and show very high correlations to the model performance on corrupted test data.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑