arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2011.09066cs.CV
收藏

面向高斯混合的深特征空间的视觉分类

Shaping Deep Feature Space towards Gaussian Mixture for Visual Classification

Tsinghua University(清华大学);University of California, Merced(加利福尼亚大学默塞德分校)

Weitao Wan, Jiansheng Chen, Cheng Yu, Tong Wu, Yuanyi Zhong, Ming-Hsuan Yang

摘要:

softmax交叉熵损失函数已被广泛用于训练各种任务的深度模型。在这项工作中,我们提出了一个高斯混合(GM)损失函数的深度神经网络的视觉分类。与softmax交叉熵损失不同,我们的方法明确地将深层特征空间塑造为高斯混合分布。通过分类裕度和似然正则化,GM损失有助于高分类性能和特征分布的准确建模。GM损失可以很容易地用于区分异常输入,如敌对的例子,基于输入和训练集的特征分布之间的差异。此外,理论分析表明,通过使用GM损失可以实现对称的特征空间,这使得模型能够鲁棒地抵抗对抗攻击。所提出的模型可以很容易地和有效地实现,而不需要使用额外的可训练参数。广泛的评估表明,所提出的方法不仅表现出良好的图像分类,但也对强大的攻击下产生的不同威胁模型的对抗性的例子鲁棒检测。

英文摘要:

The softmax cross-entropy loss function has been widely used to train deep models for various tasks. In this work, we propose a Gaussian mixture (GM) loss function for deep neural networks for visual classification. Unlike the softmax cross-entropy loss, our method explicitly shapes the deep feature space towards a Gaussian Mixture distribution. With a classification margin and a likelihood regularization, the GM loss facilitates both high classification performance and accurate modeling of the feature distribution. The GM loss can be readily used to distinguish abnormal inputs, such as the adversarial examples, based on the discrepancy between feature distributions of the inputs and the training set. Furthermore, theoretical analysis shows that a symmetric feature space can be achieved by using the GM loss, which enables the models to perform robustly against adversarial attacks. The proposed model can be implemented easily and efficiently without using extra trainable parameters. Extensive evaluations demonstrate that the proposed method performs favorably not only on image classification but also on robust detection of adversarial examples generated by strong attacks under different threat models.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑