arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1902.03514cs.CV
收藏

基于视觉记忆的人脸微表情识别

Facial Micro-Expression Spotting and Recognition using Time Contrasted Feature with Visual Memory

Kalyani Government Engineering College(卡利亚尼政府工程学院);Nanyang Technological University(南洋理工大学);Cognizant Technology Solutions(高知特科技解决方案公司);Indian Institute of Technology Roorkee(印度理工学院鲁尔基分校)

Sauradip Nag, Ayan Kumar Bhunia, Aishik Konwer, Partha Pratim Roy

摘要:

面部微表情是突然的、无意识的微小肌肉运动,它揭示了人们试图隐藏的真实情绪。由于微表情持续时间短,强度大,因此发现并识别它是一项重大挑战。许多作品追求传统的和基于深度学习的方法来解决这个问题,但由于数据集的不可用,在学习低级特征和更高的准确性上妥协。这促使我们提出了一种新的时空网络联合架构,该架构从特征图中提取时间对比特征,以对比快速肌肉运动中的微表情。时间对比特征的使用大大提高了从不明显的面部运动中发现微表情的能力。此外,我们还包括一个记忆模块来预测跨微表情剪辑的时间帧的微表情的类别和强度。我们的方法实现了优越的性能相比,其他传统的方法在CASMEII数据集。

英文摘要:

Facial micro-expressions are sudden involuntary minute muscle movements which reveal true emotions that people try to conceal. Spotting a micro-expression and recognizing it is a major challenge owing to its short duration and intensity. Many works pursued traditional and deep learning based approaches to solve this issue but compromised on learning low-level features and higher accuracy due to unavailability of datasets. This motivated us to propose a novel joint architecture of spatial and temporal network which extracts time-contrasted features from the feature maps to contrast out micro-expression from rapid muscle movements. The usage of time contrasted features greatly improved the spotting of micro-expression from inconspicuous facial movements. Also, we include a memory module to predict the class and intensity of the micro-expression across the temporal frames of the micro-expression clip. Our method achieves superior performance in comparison to other conventional approaches on CASMEII dataset.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑