arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1907.09945cs.CV
收藏

基于深度时间分析的非动作肢体情感识别

Deep Temporal Analysis for Non-Acted Body Affect Recognition

Sapienza University(萨皮恩扎大学);University of Udine(乌迪内大学)

Danilo Avola, Luigi Cinque, Alessio Fagioli, Gian Luca Foresti, Cristiano Massaroni

摘要:

情感计算在许多计算机视觉应用中是一个非常感兴趣的领域,包括视频监控、行为分析和人机交互。大多数现有的文献都通过分析不同的人脸特征集来解决这一问题。然而,在过去的十年中,一些研究已经表明身体动作如何在情绪识别中发挥关键作用。大多数这些身体实验都是由训练有素的演员进行的,其目的是模拟情绪反应。这些不自然的表情不同于更具挑战性的真实情感,因此使所获得的结果无效。本文提出了一种基于三维骨架和深度神经网络(DNN)的基本非动作情感识别解决方案。拟议的工作介绍了三个主要贡献。首先,不像目前的国家的最先进的非行动的身体影响识别,其中只考虑静态或全球的身体特征,在这项工作中,还检查在每个帧中的受试者进行的时间局部运动。第二,提供了一组原始的全局和时间相关的身体运动描述的功能。第三,据我们所知,这是第一次尝试使用深度学习方法进行非行为身体情感识别。由于该主题的新颖性,目前只有UCLIC数据集被认为是比较测试的基准。在后者,所提出的方法优于所有的竞争对手。

英文摘要:

Affective computing is a field of great interest in many computer vision applications, including video surveillance, behaviour analysis, and human-robot interaction. Most of the existing literature has addressed this field by analysing different sets of face features. However, in the last decade, several studies have shown how body movements can play a key role even in emotion recognition. The majority of these experiments on the body are performed by trained actors whose aim is to simulate emotional reactions. These unnatural expressions differ from the more challenging genuine emotions, thus invalidating the obtained results. In this paper, a solution for basic non-acted emotion recognition based on 3D skeleton and Deep Neural Networks (DNNs) is provided. The proposed work introduces three majors contributions. First, unlike the current state-of-the-art in non-acted body affect recognition, where only static or global body features are considered, in this work also temporal local movements performed by subjects in each frame are examined. Second, an original set of global and time-dependent features for body movement description is provided. Third, to the best of out knowledge, this is the first attempt to use deep learning methods for non-acted body affect recognition. Due to the novelty of the topic, only the UCLIC dataset is currently considered the benchmark for comparative tests. On the latter, the proposed method outperforms all the competitors.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑