标准化标签分布:学习校准,适应性和有效的激活图
Normalized Label Distribution: Towards Learning Calibrated, Adaptable and Efficient Activation Maps
摘要:
模型对数据畸变和对抗攻击的脆弱性影响了它们有效划分不同类边界的能力。网络的信心和不确定性在权重调整和承认此类攻击的程度方面发挥着关键作用。在本文中,我们解决了分类网络的准确性和校准潜力之间的权衡。我们研究了地面实况分布变化对各种最先进网络的性能和可推广性的意义,并比较了所提出的方法对意外攻击的响应。此外,我们展示了标签平滑正则化和归一化的作用,通过提出归一化的软标签来增强特征图的校准,从而产生更好的泛化能力和校准的概率分布。随后,我们通过将传统卷积转换为基于填充的部分卷积来证实我们的推断,以确定校正在增强性能和收敛速度方面的切实影响。我们以图形方式阐明了这种变化的含义,其关键目的是证实多个数据集的可靠性和再现性。
英文摘要:
The vulnerability of models to data aberrations and adversarial attacks influences their ability to demarcate distinct class boundaries efficiently. The network's confidence and uncertainty play a pivotal role in weight adjustments and the extent of acknowledging such attacks. In this paper, we address the trade-off between the accuracy and calibration potential of a classification network. We study the significance of ground-truth distribution changes on the performance and generalizability of various state-of-the-art networks and compare the proposed method's response to unanticipated attacks. Furthermore, we demonstrate the role of label-smoothing regularization and normalization in yielding better generalizability and calibrated probability distribution by proposing normalized soft labels to enhance the calibration of feature maps. Subsequently, we substantiate our inference by translating conventional convolutions to padding based partial convolution to establish the tangible impact of corrections in reinforcing the performance and convergence rate. We graphically elucidate the implication of such variations with the critical purpose of corroborating the reliability and reproducibility for multiple datasets.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。