Facial Micro-Expression Spotting and Recognition using Time Contrasted Feature with Visual Memory
Kalyani Government Engineering College(卡利亚尼政府工程学院);Nanyang Technological University(南洋理工大学);Cognizant Technology Solutions(高知特科技解决方案公司);Indian Institute of Technology Roorkee(印度理工学院鲁尔基分校)
Sauradip Nag, Ayan Kumar Bhunia, Aishik Konwer, Partha Pratim Roy
备注:
International Conference on Acoustics, Speech, and Signal Processing(ICASSP), 2019
Facial micro-expressions are sudden involuntary minute muscle movements which reveal true emotions that people try to conceal. Spotting a micro-expression and recognizing it is a major challenge owing to its short duration and intensity. Many works pursued traditional and deep learning based approaches to solve this issue but compromised on learning low-level features and higher accuracy due to unavailability of datasets. This motivated us to propose a novel joint architecture of spatial and temporal network which extracts time-contrasted features from the feature maps to contrast out micro-expression from rapid muscle movements. The usage of time contrasted features greatly improved the spotting of micro-expression from inconspicuous facial movements. Also, we include a memory module to predict the class and intensity of the micro-expression across the temporal frames of the micro-expression clip. Our method achieves superior performance in comparison to other conventional approaches on CASMEII dataset.
Spotting Micro-Expressions on Long Videos Sequences
CentraleSupélec(中央理工-高等电力学院);CNRS(法国国家科学研究中心);IETR(雷恩电子与电信研究所);Institute of Psychology, Chinese Academy of Sciences(中国科学院心理研究所);Manchester Metropolitan University(曼彻斯特城市大学)
Spotting Macro- and Micro-expression Intervals in Long Video Sequences
Institute of Psychology, Chinese Academy of Sciences(中国科学院心理研究所);University of the Chinese Academy of Sciences(中国科学院大学);Manchester Metropolitan University(曼彻斯特城市大学)
Synergistic Spotting and Recognition of Micro-Expression via Temporal State Transition
School of Computer and Communication Engineering, University of Science and Technology Beijing(北京科技大学计算机与通信工程学院);School of Intelligence Science and Technology, University of Science and Technology Beijing(北京科技大学智能科学与技术学院)
MEGC2025: Micro-Expression Grand Challenge on Spot Then Recognize and Visual Question Answering
Department of Computing and Mathematics, Manchester Metropolitan University(计算与数学系,曼彻斯特 Metropolitan 大学);State Key Laboratory of Cognitive Science and Mental Health, Institute of Psychology, Chinese Academy of Sciences(认知科学与心理健康国家重点实验室,心理学研究所,中国科学院);Department of Psychology, University of the Chinese Academy of Sciences(心理学系,中国科学院大学);National Taiwan University(台湾大学);Zhejiang University(浙江大学);University of Oulu(奥卢大学);Harbin Institute of Technology(哈尔滨工业大学)
MEGC2026: Micro-Expression Grand Challenge on Visual Question Answering
Department of Computing and Mathematics, Manchester Metropolitan University(曼彻斯特 Metropolitan 大学计算与数学系);State Key Laboratory of Cognitive Science and Mental Health, Institute of Psychology, CAS & Department of Psychology, University of the Chinese Academy of Sciences(中国科学院心理研究所认知科学与心理健康国家重点实验室及中国科学院大学心理学系);School of Mathematical and Computer Sciences, Heriot-Watt University Malaysia(赫瑞-沃森大学马来西亚分校数学与计算机科学学院)