arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2107.04746cs.CV
收藏

噪声背景下基于协同训练和知识蒸馏的人脸表情识别

Consensual Collaborative Training And Knowledge Distillation Based Facial Expression Recognition Under Noisy Annotations

SSSIHL(斯里萨蒂亚赛高等教育学院)

Darshan Gera, S. Balasubramanian

摘要:

大规模人脸表情数据集标签中噪声的存在是人脸表情识别面临的一个关键挑战。在早期学习阶段,深度网络适合干净的数据。然后,最终,由于它们的记忆能力,它们开始过度拟合噪声标签,这限制了FER性能。本文提出了一种有效的训练策略,在噪声标签的存在下,被称为协同训练(CCT)框架。CCT使用监督损失和一致性损失的凸组合联合训练三个网络,而不对噪声分布做任何假设。一个动态的过渡机制是用来从监督损失在早期学习的一致性损失的预测之间的共识在后期阶段。使用基于简单知识蒸馏方案的单个网络进行推理。所提出的框架的有效性证明合成以及真正的嘈杂FER数据集。此外,使用16个不同注释器的群体智慧从FEC数据集中注释了大约5K图像的大型测试子集,并推断出可靠的标签。在基准FER数据集RAFDB(90.84%)、FERPlus(89.99%)和AffectNet(66%)上报告了最先进的性能。我们的代码可在https://github.com/1980x/CCT上获得。

英文摘要:

Presence of noise in the labels of large scale facial expression datasets has been a key challenge towards Facial Expression Recognition (FER) in the wild. During early learning stage, deep networks fit on clean data. Then, eventually, they start overfitting on noisy labels due to their memorization ability, which limits FER performance. This work proposes an effective training strategy in the presence of noisy labels, called as Consensual Collaborative Training (CCT) framework. CCT co-trains three networks jointly using a convex combination of supervision loss and consistency loss, without making any assumption about the noise distribution. A dynamic transition mechanism is used to move from supervision loss in early learning to consistency loss for consensus of predictions among networks in the later stage. Inference is done using a single network based on a simple knowledge distillation scheme. Effectiveness of the proposed framework is demonstrated on synthetic as well as real noisy FER datasets. In addition, a large test subset of around 5K images is annotated from the FEC dataset using crowd wisdom of 16 different annotators and reliable labels are inferred. CCT is also validated on it. State-of-the-art performance is reported on the benchmark FER datasets RAFDB (90.84%) FERPlus (89.99%) and AffectNet (66%). Our codes are available at https://github.com/1980x/CCT.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑