arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.09707cs.CV
收藏

基于时间状态转移的微表情协同检测与识别

Synergistic Spotting and Recognition of Micro-Expression via Temporal State Transition

School of Computer and Communication Engineering, University of Science and Technology Beijing(北京科技大学计算机与通信工程学院);School of Intelligence Science and Technology, University of Science and Technology Beijing(北京科技大学智能科学与技术学院)

Bochao Zou, Zizheng Guo, Wenfeng Qin, Xin Li, Kangsheng Wang, Huimin Ma

AI总结:

针对现有微表情检测与识别方法受滑动窗口限制、未利用任务互补性的问题,提出基于状态空间模型的时间状态转移架构与协同策略,用视频级回归替代窗口级分类,实现了当前最优性能。

摘要:

微表情是无法被有意识控制的非自主面部运动,传递着细微的线索,在现实世界中具有大量应用场景。微表情分析通常包含两大核心任务:在长视频中检测微表情区间,以及识别这些区间对应的情绪。以往的深度学习方法主要依赖采用滑动窗口的分类网络,但固定窗口尺寸以及窗口级硬分类带来了诸多限制。此外,这些方法尚未充分挖掘检测与识别两条互补路径的潜力。本文提出了一种基于状态空间模型的新型时间状态转移架构,用视频级回归替代了传统的窗口级分类。进一步地,通过利用检测与识别任务之间的内在关联,我们提出了一种协同策略以提升整体分析性能。大量实验表明,我们的方法达到了当前最优性能。代码与预训练模型可在https://github.com/zizheng-guo/ME-TST 获取。

英文摘要:

Micro-expressions are involuntary facial movements that cannot be consciously controlled, conveying subtle cues with substantial real-world applications. The analysis of micro-expressions generally involves two main tasks: spotting micro-expression intervals in long videos and recognizing the emotions associated with these intervals. Previous deep learning methods have primarily relied on classification networks utilizing sliding windows. However, fixed window sizes and window-level hard classification introduce numerous constraints. Additionally, these methods have not fully exploited the potential of complementary pathways for spotting and recognition. In this paper, we present a novel temporal state transition architecture grounded in the state space model, which replaces conventional window-level classification with video-level regression. Furthermore, by leveraging the inherent connections between spotting and recognition tasks, we propose a synergistic strategy that enhances overall analysis performance. Extensive experiments demonstrate that our method achieves state-of-the-art performance. The codes and pre-trained models are available at https://github.com/zizheng-guo/ME-TST.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑