arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2105.02103cs.CVcs.AIcs.LG
收藏

大规模人脸表示学习的原型记忆

Prototype Memory for Large-scale Face Representation Learning

Speech Technology Center(语音技术中心);ITMO University(圣彼得堡国立信息技术机械与光学大学)

Evgeny Smirnov, Nikita Garaev, Vasiliy Galyuk, Evgeny Lukyanets

摘要:

使用具有大量身份的数据集的人脸表示学习需要适当的训练方法。基于softmax的方法,目前最先进的人脸识别,在其通常的“全softmax”形式是不适合与数百万人的数据集。提出了几种基于“sampled softmax”方法的方法来消除这种限制。然而,这些方法具有一系列缺点。其中之一是“原型过时”的问题:很少采样的类的分类器权重(原型)接收太少的梯度,变得过时并与当前编码器状态分离,导致不正确的训练信号。这个问题在超大规模数据集中尤为严重。在本文中,我们提出了一种新的人脸表示学习模型,称为原型记忆,它解决了这个问题,并允许在任何大小的数据集上进行训练。原型内存由有限大小的内存模块组成,用于存储最近的类原型,并采用一组算法以适当的方式更新它。新的类原型是使用当前mini-batch中的范例嵌入动态生成的。这些原型被排队到内存中,并用于基于softmax分类的训练的分类器权重。为了防止过时并保持存储器与编码器的紧密联系,原型会定期更新,最旧的原型会被排出队列并处理掉。Prototype Memory在计算上是高效的,并且与数据集大小无关。它可以与各种损失函数、硬示例挖掘算法和编码器架构一起使用。我们证明了该模型的有效性,通过广泛的实验流行的人脸识别基准。

英文摘要:

Face representation learning using datasets with a massive number of identities requires appropriate training methods. Softmax-based approach, currently the state-of-the-art in face recognition, in its usual "full softmax" form is not suitable for datasets with millions of persons. Several methods, based on the "sampled softmax" approach, were proposed to remove this limitation. These methods, however, have a set of disadvantages. One of them is a problem of "prototype obsolescence": classifier weights (prototypes) of the rarely sampled classes receive too scarce gradients and become outdated and detached from the current encoder state, resulting in incorrect training signals. This problem is especially serious in ultra-large-scale datasets. In this paper, we propose a novel face representation learning model called Prototype Memory, which alleviates this problem and allows training on a dataset of any size. Prototype Memory consists of the limited-size memory module for storing recent class prototypes and employs a set of algorithms to update it in appropriate way. New class prototypes are generated on the fly using exemplar embeddings in the current mini-batch. These prototypes are enqueued to the memory and used in a role of classifier weights for softmax classification-based training. To prevent obsolescence and keep the memory in close connection with the encoder, prototypes are regularly refreshed, and oldest ones are dequeued and disposed of. Prototype Memory is computationally efficient and independent of dataset size. It can be used with various loss functions, hard example mining algorithms and encoder architectures. We prove the effectiveness of the proposed model by extensive experiments on popular face recognition benchmarks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑