arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2603.04766cs.CVcs.CY
收藏

评估和纠正动态微表情识别中的人类标注偏差

Evaluating and Correcting Human Annotation Bias in Dynamic Micro-Expression Recognition

School of Psychology, Shanghai Jiao Tong University(心理学系,上海交通大学);School of Artificial Intelligence and Computer Science, Jiangnan University(人工智能与计算机科学学院,江南大学)

Feng Liu, Bingyu Nan, Xuezhong Qian, Xiaolan Fu

AI总结:

本文提出GAMDSS架构,通过动态关键帧重选提升微表情识别性能,减少跨文化数据集中的标注偏差。

摘要:

现有手动标注的微表情存在准确性错误,尤其是在跨文化场景中,关键帧的标注偏差更加明显。为了解决这个问题,本文提出了一种新的全局反单调差分选择策略(GAMDSS)架构,通过关键帧重选来增强微表情时空建模的有效性。具体来说,该方法通过动态帧重选机制从完整的微表情动作序列中识别出起始帧和顶点帧,这些帧具有显著的微表情变化特征。然后利用这些帧确定偏移帧并构建丰富的时空动态表示。接着使用一个具有共享参数的双分支结构来高效提取时空特征。在七个广泛认可的微表情数据集上进行了大量实验。结果表明,GAMDSS有效减少了因人类因素在跨文化数据集(如SAMM和4DME)中引起的主观误差。此外,定量分析证实跨文化数据集中的偏移帧注释更加不确定,为标准化微表情注释提供了理论依据。这些发现直接支持了我们重新考虑数据集注释范式有效性和通用性的论点。值得注意的是,这种设计可以集成到现有模型中而不增加参数数量,提供了一种增强微表情识别性能的新方法。源代码可在GitHub[https://github.com/Cross-Innovation-Lab/GAMDSS]上获取。

英文摘要:

Existing manual labeling of micro-expressions is subject to errors in accuracy, especially in cross-cultural scenarios where deviation in labeling of key frames is more prominent. To address this issue, this paper presents a novel Global Anti-Monotonic Differential Selection Strategy (GAMDSS) architecture for enhancing the effectiveness of spatio-temporal modeling of micro-expressions through keyframe re-selection. Specifically, the method identifies Onset and Apex frames, which are characterized by significant micro-expression variation, from complete micro-expression action sequences via a dynamic frame reselection mechanism. It then uses these to determine Offset frames and construct a rich spatio-temporal dynamic representation. A two-branch structure with shared parameters is then used to efficiently extract spatio-temporal features. Extensive experiments are conducted on seven widely recognized micro-expression datasets. The results demonstrate that GAMDSS effectively reduces subjective errors caused by human factors in multicultural datasets such as SAMM and 4DME. Furthermore, quantitative analyses confirm that offset-frame annotations in multicultural datasets are more uncertain, providing theoretical justification for standardizing micro-expression annotations. These findings directly support our argument for reconsidering the validity and generalizability of dataset annotation paradigms. Notably, this design can be integrated into existing models without increasing the number of parameters, offering a new approach to enhancing micro-expression recognition performance. The source code is available on GitHub[https://github.com/Cross-Innovation-Lab/GAMDSS].

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑