arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2209.06322cs.CV
收藏

FaceTopoNet:基于人脸拓扑学习的人脸表情识别

FaceTopoNet: Facial Expression Recognition using Face Topology Learning

Ingenuity Labs Research Institute(英格纽蒂实验室研究所);Irdeto Canada Corporation(加拿大爱迪德公司)

Mojtaba Kolahdouzi, Alireza Sepas-Moghaddam, Ali Etemad

摘要:

先前的工作已经表明,使用顺序学习器学习面部的不同组成部分的顺序可以在面部表情识别系统的性能中发挥重要作用。我们提出了FaceTopoNet,这是一个用于面部表情识别的端到端深度模型,它能够学习面部的有效树拓扑。然后,我们的模型遍历学习过的树以生成一个序列,然后将其用于形成一个嵌入来为顺序学习器提供信息。所设计的模型采用一个流学习结构和一个流学习纹理。结构流关注面部标志的位置,而纹理流的主要关注点是标志周围的补丁,以学习纹理信息。然后,我们利用一个有效的基于注意力的融合策略融合两个流的输出。我们在四个大规模的野生面部表情数据集上进行了广泛的实验-即AffectNet,FER 2013,ExpW和RAF-DB -以及一个实验室控制的数据集(CK+)来评估我们的方法。FaceTopoNet在五个数据集中的三个数据集上实现了最先进的性能,并在其他两个数据集上获得了有竞争力的结果。我们还进行了严格的消融和敏感性实验,以评估模型中不同组件和参数的影响。最后,我们进行了鲁棒性实验,并证明了FaceTopoNet与该领域的其他领先方法相比,对遮挡更鲁棒。

英文摘要:

Prior work has shown that the order in which different components of the face are learned using a sequential learner can play an important role in the performance of facial expression recognition systems. We propose FaceTopoNet, an end-to-end deep model for facial expression recognition, which is capable of learning an effective tree topology of the face. Our model then traverses the learned tree to generate a sequence, which is then used to form an embedding to feed a sequential learner. The devised model adopts one stream for learning structure and one stream for learning texture. The structure stream focuses on the positions of the facial landmarks, while the main focus of the texture stream is on the patches around the landmarks to learn textural information. We then fuse the outputs of the two streams by utilizing an effective attention-based fusion strategy. We perform extensive experiments on four large-scale in-the-wild facial expression datasets - namely AffectNet, FER2013, ExpW, and RAF-DB - and one lab-controlled dataset (CK+) to evaluate our approach. FaceTopoNet achieves state-of-the-art performance on three of the five datasets and obtains competitive results on the other two datasets. We also perform rigorous ablation and sensitivity experiments to evaluate the impact of different components and parameters in our model. Lastly, we perform robustness experiments and demonstrate that FaceTopoNet is more robust against occlusions in comparison to other leading methods in the area.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑