arXiv 2102.080682021-02-16cs.CVcs.AI

A comparative study on movement feature in different directions for micro-expression recognition

Nanjing University of Posts and Telecommunications（南京邮电大学）

Jinsheng Wei, Guanming Lu, Jingjie Yan

英文摘要：

Micro-expression can reflect people's real emotions. Recognizing micro-expressions is difficult because they are small motions and have a short duration. As the research is deepening into micro-expression recognition, many effective features and methods have been proposed. To determine which direction of movement feature is easier for distinguishing micro-expressions, this paper selects 18 directions (including three types of horizontal, vertical and oblique movements) and proposes a new low-dimensional feature called the Histogram of Single Direction Gradient (HSDG) to study this topic. In this paper, HSDG in every direction is concatenated with LBP-TOP to obtain the LBP with Single Direction Gradient (LBP-SDG) and analyze which direction of movement feature is more discriminative for micro-expression recognition. As with some existing work, Euler Video Magnification (EVM) is employed as a preprocessing step. The experiments on the CASME II and SMIC-HS databases summarize the effective and optimal directions and demonstrate that HSDG in an optimal direction is discriminative, and the corresponding LBP-SDG achieves state-of-the-art performance using EVM.

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

阅读原文

阅读 PDF ↗

arXiv 页面 ↗HTML 原文 ↗

本文内容

英文摘要相关论文

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

继续探索

相关论文

历史影像中的摄像机运动分类：深度视频模型的比较研究

Camera Movement Classification in Historical Footage: A Comparative Study of Deep Video Models

本文首次系统评估深度视频模型在历史影像上的摄像机运动分类，发现Video Swin Transformer在HISTORIAN数据集上以80.25%准确率最优，凸显低质量视频适配挑战与潜力。

2025-10-16cs.AIcs.CVeess.IV

SMA-STN: Segmented Movement-Attending Spatiotemporal Network forMicro-Expression Recognition

School of Biological Science and Medical Engineering, Southeast University（东南大学生物科学与医学工程学院）

Correctly perceiving micro-expression is difficult since micro-expression is an involuntary, repressed, and subtle facial expression, and efficiently revealing the subtle movement changes and capturing the significant segments in a micro-expression sequence is the key to micro-expression recognition (MER). To handle the crucial issue, in this paper, we firstly propose a dynamic segmented sparse imaging module (DSSI) to compute dynamic images as local-global spatiotemporal descriptors under a unique sampling protocol, which reveals the subtle movement changes visually in an efficient way. Secon…

2020-10-19cs.AIcs.CV

Objective Micro-Facial Movement Detection Using FACS-Based Regions and Baseline Evaluation

Manchester Metropolitan University（曼彻斯特城市大学）；Panasonic R&D Center（松下研发中心）；Emotional Intelligence Academy（情商学院）

Micro-facial expressions are regarded as an important human behavioural event that can highlight emotional deception. Spotting these movements is difficult for humans and machines, however research into using computer vision to detect subtle facial expressions is growing in popularity. This paper proposes an individualised baseline micro-movement detection method using 3D Histogram of Oriented Gradients (3D HOG) temporal difference method. We define a face template consisting of 26 regions based on the Facial Action Coding System (FACS). We extract the temporal features of each region using 3D…

2016-12-15cs.CV

GazeMAE: General Representations of Eye Movements using a Micro-Macro Autoencoder

Department of Computer Science University of the Philippines（菲律宾大学计算机科学系（菲律宾大学））

Eye movements are intricate and dynamic events that contain a wealth of information about the subject and the stimuli. We propose an abstract representation of eye movements that preserve the important nuances in gaze behavior while being stimuli-agnostic. We consider eye movements as raw position and velocity signals and train separate deep temporal convolutional autoencoders. The autoencoders learn micro-scale and macro-scale representations that correspond to the fast and slow features of eye movements. We evaluate the joint representations with a linear classifier fitted on various classif…

2020-10-25cs.CVcs.LG

Deep Eyedentification: Biometric Identification using Micro-Movements of the Eye

University of Potsdam（波茨坦大学）

We study involuntary micro-movements of the eye for biometric identification. While prior studies extract lower-frequency macro-movements from the output of video-based eye-tracking systems and engineer explicit features of these macro-movements, we develop a deep convolutional architecture that processes the raw eye-tracking signal. Compared to prior work, the network attains a lower error rate by one order of magnitude and is faster by two orders of magnitude: it identifies users accurately within seconds.

2020-05-05cs.CLcs.CVcs.HC

本体对生物力学和功能有何影响？对盲人和低视力者手部手持和头戴辅助设备的比较分析

Does Embodiment Matter to Biomechanics and Function? A Comparative Analysis of Head-Mounted and Hand-Held Assistive Devices for Individuals with Blindness and Low Vision

Steinhardt School of Culture, Education, and Human Development, New York University（纽约大学文化、教育与人类发展学院）；Rusk Rehabilitation, NYU Langone Health（Rusk康复中心，NYU Langone健康）；Department of Rehabilitation Medicine, NYU Grossman School of Medicine（纽约大学格罗斯曼医学院康复医学系）；ARxVision LLC（ARxVision公司）；Department of Ophthalmology, NYU Grossman School of Medicine（纽约大学格罗斯曼医学院眼科学系）；Department of Neurology, NYU Langone Health（纽约大学Langone健康神经学系）

研究比较了头戴式和手持式辅助设备在日常活动中的表现，发现头戴设备减少上半身运动和任务时间，而手持设备在处理小或弯曲文本任务时成功率更高，表明两种设备各有优劣。

2025-09-22cs.CVcs.HC

更多相关论文收起更多论文

用于微表情识别的HTNet

HTNet for micro-expression recognition

Australian National University（澳大利亚国立大学）；Sun Yat-sen University（中山大学）

针对微表情识别中肌肉运动微妙且现有方法忽略面部空间关系的问题，提出分层Transformer网络（HTNet），通过划分面部区域并利用局部自注意力与聚合层捕捉局部及全局特征，在四个数据集上取得显著优于以往方法的性能。

2023-07-27cs.CV

Facial Micro-Expression Spotting and Recognition using Time Contrasted Feature with Visual Memory

Kalyani Government Engineering College（卡利亚尼政府工程学院）；Nanyang Technological University（南洋理工大学）；Cognizant Technology Solutions（高知特科技解决方案公司）；Indian Institute of Technology Roorkee（印度理工学院鲁尔基分校）

Facial micro-expressions are sudden involuntary minute muscle movements which reveal true emotions that people try to conceal. Spotting a micro-expression and recognizing it is a major challenge owing to its short duration and intensity. Many works pursued traditional and deep learning based approaches to solve this issue but compromised on learning low-level features and higher accuracy due to unavailability of datasets. This motivated us to propose a novel joint architecture of spatial and temporal network which extracts time-contrasted features from the feature maps to contrast out micro-ex…

2019-04-19cs.CV

基于人工智能增强微超声的前列腺癌筛查：与传统方法的对比研究

Prostate Cancer Screening with Artificial Intelligence-Enhanced Micro-Ultrasound: A Comparative Study with Traditional Methods

University of Florida（佛罗里达大学）

本研究提出基于自监督卷积自编码器与随机森林的微超声AI分析系统，在145名患者数据上实现了0.871的AUROC，优于PSA等临床筛查方法，在保持高敏感性的同时显著提高了特异性，有望减少不必要活检。

2025-05-27cs.AIcs.CVeess.IV

利用CNN预测S&P 500股票走势

S&P 500 Stock's Movement Prediction using CNN

Stanford University（斯坦福大学）

本文提出利用CNN处理多维股票数据预测S&P 500指数走势，采用真实市场数据而非工程化数据，通过将历史数据矩阵模拟为图像进行分类，实现股票、行业或投资组合的预测。

2025-12-25cs.AIcs.CEcs.CV

Towards Reading Hidden Emotions: A comparative Study of Spontaneous Micro-expression Spotting and Recognition Methods

University of Oulu（奥卢大学）；University of Oxford（牛津大学）

Micro-expressions (MEs) are rapid, involuntary facial expressions which reveal emotions that people do not intend to show. Studying MEs is valuable as recognizing them has many important applications, particularly in forensic science and psychotherapy. However, analyzing spontaneous MEs is very challenging due to their short duration and low intensity. Automatic ME analysis includes two tasks: ME spotting and ME recognition. For ME spotting, previous studies have focused on posed rather than spontaneous videos. For ME recognition, the performance of previous studies is low. To address these ch…

2017-02-08cs.CV

LEARNet Dynamic Imaging Network for Micro Expression Recognition

Unlike prevalent facial expressions, micro expressions have subtle, involuntary muscle movements which are short-lived in nature. These minute muscle movements reflect true emotions of a person. Due to the short duration and low intensity, these micro-expressions are very difficult to perceive and interpret correctly. In this paper, we propose the dynamic representation of micro-expressions to preserve facial movement information of a video in a single frame. We also propose a Lateral Accretive Hybrid Network (LEARNet) to capture micro-level features of an expression in the facial region. The …

2019-04-20cs.CV

增强健身动作识别：注意力机制与预训练特征提取器

Enhancing Fitness Movement Recognition with Attention Mechanism and Pre-Trained Feature Extractors

Department of Computer Science & Engineering（计算机科学与工程系）；Rajshahi University of Engineering & Technology（拉贾堪普尔工程与技术大学）

本文提出一个轻量级框架，结合预训练2D CNN（如ResNet50）与空间注意力增强的LSTM，在UCF101子集上实现93.34%的峰值准确率，为健身动作识别提供可扩展且实时的解决方案。

2025-10-07cs.CV

不同深度学习架构下可穿戴设备与单摄像头视频用于实验室外上肢活动识别的比较研究

A comparative study on wearables and single-camera video for upper-limb out-of-thelab activity recognition with different deep learning architectures

University of Valladolid（巴利亚多利德大学）；University of Geneva（日内瓦大学）；University of Applied Sciences Western Switzerland (HES-SO) Valais-Wallis（瑞士西部应用科学与艺术大学（HES-SO）瓦莱-沃利斯）

本研究比较了可穿戴IMU与单摄像头视频在不同深度学习架构下用于实验室外上肢活动识别的效果，旨在确定机器学习系统的理想输入，以提高患者追踪的可行性。

2024-02-04cs.CVcs.LGeess.SP

The Computerized Classification of Micro-Motions in the Hand using Waveforms from Mobile Phone

National Public School（国立公立学校）

Our hands reveal important information such as the pulsing of our veins which help us determine the blood pressure, tremors indicative of motor control, or neurodegenerative disorders such as Essential Tremor or Parkinson's disease. The Computerized Classification of Micro-Motions in the hand using waveforms from mobile phone videos is a novel method that uses Eulerian Video Magnification, Skeletonization, Heatmapping, and the kNN machine learning model to detect the micro-motions in the human hand, synthesize their waveforms, and classify these. The pre-processing is achieved by using Euleria…

2021-10-13cs.CVcs.LG

Tracking of Micro Unmanned Aerial Vehicles: A Comparative Study

Süleyman Demirel University（苏莱曼·德米雷尔大学）

Micro unmanned aerial vehicles (mUAV) became very common in recent years. As a result of their widespread usage, when they are flown by hobbyists illegally, crucial risks are imposed and such mUAVs need to be sensed by security systems. Furthermore, the sensing of mUAVs are essential for also swarm robotics research where the individuals in a flock of robots require systems to sense and localize each other for coordinated operation. In order to obtain such systems, there are studies to detect mUAVs utilizing different sensing mediums, such as vision, infrared and sound signals, and small-scale…

2020-01-16cs.CVcs.RO