arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1905.05360cs.HC
收藏

基于多通道面部响应的眼镜式可穿戴设备情绪识别

Emotion recognition using a glasses-type wearable device via multi-channel facial responses

Jangho Kwon, Laehyun Kim

AI总结:

本研究提出一种眼镜式非侵入式可穿戴设备,通过采集面部EDA、光电容积脉搏波及左眼局部表情等多通道响应,结合优化的传感器位置与识别算法,将情绪分类准确率较仅用局部表情提升10.1%,可用于日常情绪监测,具备医疗健康应用潜力。

摘要:

我们提出了一种眼镜式可穿戴设备,能够以非侵入式方式从人脸检测情绪。该设备被设计为在用户佩戴时自然且持续地采集用户面部的多通道响应。这些多通道响应包括基于皮肤电活动(electrodermal activity, EDA)和光电容积脉搏波的面部肌肉与器官生理响应。由于EDA信号质量对传感位置非常敏感,我们开展了实验以确定EDA传感器在可穿戴设备上的最佳位置。除生理数据外,该设备还可通过内置摄像头捕捉左眼周围代表局部面部表情的图像区域。在本研究中,我们开发并验证了一种利用该设备采集的多通道响应识别情绪的算法。结果表明,仅使用局部面部表情的情绪识别算法在情绪分类上的准确率为78%;使用多通道数据后,该准确率提升了10.1%。这种搭载面部多通道响应的非侵入式可穿戴系统对日常生活中的用户情绪监测非常实用,在医疗健康行业具有巨大应用潜力。

英文摘要:

We present a glasses type wearable device to detect emotions from a human face in an unobtrusive manner. The device is designed to gather multi channel responses from the user face naturally and continuously while the user is wearing it. The multi channel responses include physiological responses of the facial muscles and organs based on electrodermal activity (EDA) and photoplethysmogram. We conducted experiments to determine the optimal positions of EDA sensors on the wearable device because EDA signal quality is very sensitive to the sensing position. In addition to the physiological data, the device can capture the image region representing local facial expressions around the left eye via a built in camera. In this study, we developed and validated an algorithm to recognize emotions using multi channel responses obtained from the device. The results show that the emotion recognition algorithm using only local facial expressions has an accuracy of 78 percent at classifying emotions. Using multi channel data, this accuracy was increased by 10.1 percent. This unobtrusive wearable system with facial multi channel responses is very useful for monitoring a user emotions in daily life, which has a huge potential for use in the healthcare industry.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑