arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1609.09761cs.HC
收藏

从面部表情中检测认知评价用于兴趣识别

Detecting Cognitive Appraisals from Facial Expressions for Interest Recognition

Mohammad Soleymani

摘要:

兴趣使人把注意力集中在感兴趣的对象上。兴趣自动识别在人机交互中有着广泛的应用。在本文中,我们研究了面部表情与兴趣及其潜在的和密切相关的组件,即好奇心,应对潜力,新颖性和复杂性。为此,我们进行了一项实验,参与者观看图像和微视频,同时前置摄像头记录他们的表情。在观看完每一个项目后,他们自我报告了他们的兴趣,好奇心,应对潜力以及感知的新颖性和复杂性。使用自动化的方法,我们跟踪面部动作单位(AU),并研究了感兴趣的面部运动的存在及其相关组件之间的关系。然后我们跟踪了面部标志,例如,嘴角,并从每个响应中提取特征。我们训练了随机森林回归模型来检测兴趣、好奇心和评价的水平。我们发现人们对有趣的视觉内容的报告和反应方式之间存在很大差异。对图像和微视频的反应并不总是取决于参与者的表达。这使得从面部表情中直接检测兴趣成为一个具有挑战性的问题。通过这项工作,我们首次证明了从面部表情中检测认知评价的可行性,这将为评价驱动的情感识别方法打开大门。

英文摘要:

Interest makes one hold her attention on the object of interest. Automatic recognition of interest has numerous applications in human-computer interaction. In this paper, we study the facial expressions associated with interest and its underlying and closely related components, namely, curiosity, coping potential, novelty and complexity. To this end, we conducted an experiment in which participants watched images and micro-videos while a front-facing camera recorded their expressions. After watching each item they self-reported their level of interest, curiosity, coping potential and perceived novelty and complexity. Using an automated method, we tracked facial action units (AU) and studied the relationship between the presence of facial movements with interest and its related components. We then tracked the facial landmarks, e.g., corners of lips, and extracted features from each response. We trained random forests regression models to detect the level of interest, curiosity, and appraisals. We found a large difference between the way people report and react to interesting visual content. The expressions in response to images and micro-videos were not always pronounced depending on the participants. This makes the direct detection of interest from facial expressions a challenging problem. With this work, for the first time, we demonstrate the feasibility of detecting cognitive appraisals from facial expressions which will open the door for appraisal-driven emotion recognition methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑