arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2203.06935cs.MM
收藏

情感计算的系统综述:情感模型、数据库和最新进展

A Systematic Review on Affective Computing: Emotion Models, Databases, and Recent Advances

Yan Wang, Wei Song, Wei Tao, Antonio Liotta, Dawei Yang, Xinlei Li, Shuyong Gao, Yixuan Sun, Weifeng Ge, Wei Zhang, Wenqiang Zhang

摘要:

情感计算在人机交互、娱乐、教学、安全驾驶和多媒体集成等方面发挥着重要作用。最近在情感计算(即,情感识别和情感分析)。情感计算是基于单峰或多峰数据实现的,主要包括物理信息(例如,文本、音频和视觉数据)和生理信号(例如,EEG和ECG信号)。基于身体的情感识别迎合了更多的研究者,由于多个公共数据库。然而,它是很难揭示一个人的内心情感隐藏故意从面部表情,音频音调,身体姿势等生理信号可以产生更精确和可靠的情感结果,但在获取生理信号的困难也阻碍了他们的实际应用。因此,物理信息和生理信号的融合可以提供情绪状态的有用特征,并导致更高的准确性。而不是专注于一个特定的领域的情感分析,我们系统地回顾了情感计算的最新进展,并分类单峰的影响识别以及多模态的情感分析。首先,我们介绍了两个典型的情感模型,其次是常用的情感计算数据库。接下来,我们调查和分类的最先进的单模态情感识别和多模态情感分析方面的详细架构和性能。最后,我们讨论了情感计算及其应用的一些重要方面,并总结了最有前途的未来发展方向,如基线数据集的建立,多模态情感分析的融合策略,和无监督学习模型。

英文摘要:

Affective computing plays a key role in human-computer interactions, entertainment, teaching, safe driving, and multimedia integration. Major breakthroughs have been made recently in the areas of affective computing (i.e., emotion recognition and sentiment analysis). Affective computing is realized based on unimodal or multimodal data, primarily consisting of physical information (e.g., textual, audio, and visual data) and physiological signals (e.g., EEG and ECG signals). Physical-based affect recognition caters to more researchers due to multiple public databases. However, it is hard to reveal one's inner emotion hidden purposely from facial expressions, audio tones, body gestures, etc. Physiological signals can generate more precise and reliable emotional results; yet, the difficulty in acquiring physiological signals also hinders their practical application. Thus, the fusion of physical information and physiological signals can provide useful features of emotional states and lead to higher accuracy. Instead of focusing on one specific field of affective analysis, we systematically review recent advances in the affective computing, and taxonomize unimodal affect recognition as well as multimodal affective analysis. Firstly, we introduce two typical emotion models followed by commonly used databases for affective computing. Next, we survey and taxonomize state-of-the-art unimodal affect recognition and multimodal affective analysis in terms of their detailed architectures and performances. Finally, we discuss some important aspects on affective computing and their applications and conclude this review with an indication of the most promising future directions, such as the establishment of baseline dataset, fusion strategies for multimodal affective analysis, and unsupervised learning models.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑