如何合成大规模可训练的微表情数据集?
How to Synthesize a Large-Scale and Trainable Micro-Expression Dataset?
摘要:
本文不包含技术新颖性,但介绍了我们在数据生成协议,数据库和见解的关键发现。由于数据汇集成本过高,使得大规模训练不太可行,因此我们的目标是解决微表情(MiE)识别中缺乏大规模数据集的问题。为此,我们开发了一个协议,自动合成大规模的MiE训练数据,使我们能够训练改进的识别模型,为现实世界的测试数据。具体来说,我们发现了三种类型的行动单位(AU),可以构成可训练的MIEs。这些AU来自真实世界的MiE,宏表情视频的早期帧,以及AU和由人类专家知识定义的表情类别之间的关系。有了这些AU,我们的协议然后采用大量的各种身份的面部图像和现成的面部生成器进行MiE合成,产生MiE-X数据集。MiE识别模型在MiE-X上进行训练或预训练,并在真实世界的测试集上进行评估,获得非常有竞争力的准确性。实验结果不仅验证了所发现的AU和MiE-X数据集的有效性,而且还揭示了MiE的一些有趣特性:它们在人脸中泛化,接近早期的宏表达式,并且可以手动定义。
英文摘要:
This paper does not contain technical novelty but introduces our key discoveries in a data generation protocol, a database and insights. We aim to address the lack of large-scale datasets in micro-expression (MiE) recognition due to the prohibitive cost of data collection, which renders large-scale training less feasible. To this end, we develop a protocol to automatically synthesize large scale MiE training data that allow us to train improved recognition models for real-world test data. Specifically, we discover three types of Action Units (AUs) that can constitute trainable MiEs. These AUs come from real-world MiEs, early frames of macro-expression videos, and the relationship between AUs and expression categories defined by human expert knowledge. With these AUs, our protocol then employs large numbers of face images of various identities and an off-the-shelf face generator for MiE synthesis, yielding the MiE-X dataset. MiE recognition models are trained or pre-trained on MiE-X and evaluated on real-world test sets, where very competitive accuracy is obtained. Experimental results not only validate the effectiveness of the discovered AUs and MiE-X dataset but also reveal some interesting properties of MiEs: they generalize across faces, are close to early-stage macro-expressions, and can be manually defined.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。