arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2002.08034cs.HC
收藏

基于生理信号的情绪识别

Emotion Recognition Through Observer's Physiological Signals

Yang Liu, Tom Gedeon, Sabrina Caldwell, Shouxu Lin, Zi Jin

摘要:

基于生理信号的情感识别是一个热门话题,在安全驾驶、医疗保健和创建安全社会等方面有着广泛的应用。本文介绍了一个生理数据集PAFEW,这是使用电影剪辑从野生动物面部表情(AFEW)数据集作为刺激。为了建立基线,我们使用该数据集中的皮肤电活动(EDA)信号,并从对应于每个电影片段的每个信号序列中提取6个特征来识别7种情绪,即,愤怒,厌恶,恐惧,快乐,惊讶,悲伤和中性。总体而言,24名观察员参与了我们收集的培训集,其中19名观察员仅参加了一次会议,观看了来自7个班级的80个视频,5名观察员多次参加并观看了所有视频。所有的视频都以一种平衡的方式呈现。在这个分类任务中使用了留一筛选器。我们报告了我们的基线(一个三层网络)在这个初始训练集上的分类准确性,同时使用来自所有参与者、单个参与者和多个参与者的信号进行训练。我们还研究了按唤醒度和效价对数据集进行分组的识别准确率,分别达到68.66%和72.72%。最后,我们提供了一个两步网络。第一步是通过网络将特征分类为高/低唤醒或正/负效价。然后将第一步的唤醒/效价中间输出与作为第二步情感识别的输入的特征集连接。我们发现,增加唤醒或效价信息可以帮助提高分类精度。此外,正/负价信息在此数据集上提高了分类准确率。

英文摘要:

Emotion recognition based on physiological signals is a hot topic and has a wide range of applications, like safe driving, health care and creating a secure society. This paper introduces a physiological dataset PAFEW, which is obtained using movie clips from the Acted Facial Expressions in the Wild (AFEW) dataset as stimuli. To establish a baseline, we use the electrodermal activity (EDA) signals in this dataset and extract 6 features from each signal series corresponding to each movie clip to recognize 7 emotions, i.e., Anger, Disgust, Fear, Happy, Surprise, Sad and Neutral. Overall, 24 observers participated in our collection of the training set, including 19 observers who participated in only one session watching 80 videos from 7 classes and 5 observers who participated multiple times and watched all the videos. All videos were presented in an order balanced fashion. Leave-one-observer-out was employed in this classification task. We report the classification accuracy of our baseline, a three-layer network, on this initial training set while training with signals from all participants, only single participants and only multiple participants. We also investigate the recognition accuracy of grouping the dataset by arousal or valence, which achieves 68.66% and 72.72% separately. Finally, we provide a two-step network. The first step is to classify the features into high/low arousal or positive/negative valence by a network. Then the arousal/valence middle output of the first step is concatenated with feature sets as input of the second step for emotion recognition. We found that adding arousal or valence information can help to improve the classification accuracy. In addition, the information of positive/negative valence boosts the classification accuracy to a higher degree on this dataset.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑