arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2006.05327cs.CVcs.HC
收藏

mEBAL:一个用于眨眼检测与注意力水平估计的多模态数据库

mEBAL: A Multimodal Database for Eye Blink Detection and Attention Level Estimation

Biometrics and Data Pattern Analytics, BiDA-Lab, Universidad Autonoma de Madrid, Spain(生物特征与数据模式分析,BiDA实验室,马德里自治大学,西班牙)

Roberto Daza, Aythami Morales, Julian Fierrez, Ruben Tolosana

AI总结:

本文提出多模态数据库mEBAL,融合NIR、RGB摄像头和EEG采集38名学生的6000个样本,并基于CNN和眨眼频率进行眨眼检测与注意力水平估计。

摘要:

本文提出了mEBAL,一个用于眨眼检测和注意力水平估计的多模态数据库。眨眼频率与认知活动相关,自动眨眼检测器已被用于许多任务,包括注意力水平估计、神经退行性疾病分析、欺骗识别、驾驶疲劳检测或人脸反欺骗。然而,该领域现有的大多数数据库和算法仅限于仅涉及几百个样本和单个传感器(如面部摄像头)的实验。所提出的mEBAL在采集传感器和样本数量方面改进了以往的数据库。具体来说,同时考虑了三种不同的传感器:近红外(NIR)和RGB摄像头用于捕捉面部姿态,以及脑电图(EEG)频带用于捕捉用户的认知活动和眨眼事件。关于mEBAL的规模,它包含来自38名不同学生在执行多项难度不同的电子学习任务时的6,000个样本及相应的注意力水平。除了介绍mEBAL之外,我们还纳入了以下初步实验:i)使用卷积神经网络(CNN)结合面部图像进行眨眼检测,以及ii)基于学生眨眼频率的注意力水平估计。

英文摘要:

This work presents mEBAL, a multimodal database for eye blink detection and attention level estimation. The eye blink frequency is related to the cognitive activity and automatic detectors of eye blinks have been proposed for many tasks including attention level estimation, analysis of neuro-degenerative diseases, deception recognition, drive fatigue detection, or face anti-spoofing. However, most existing databases and algorithms in this area are limited to experiments involving only a few hundred samples and individual sensors like face cameras. The proposed mEBAL improves previous databases in terms of acquisition sensors and samples. In particular, three different sensors are simultaneously considered: Near Infrared (NIR) and RGB cameras to capture the face gestures and an Electroencephalography (EEG) band to capture the cognitive activity of the user and blinking events. Regarding the size of mEBAL, it comprises 6,000 samples and the corresponding attention level from 38 different students while conducting a number of e-learning tasks of varying difficulty. In addition to presenting mEBAL, we also include preliminary experiments on: i) eye blink detection using Convolutional Neural Networks (CNN) with the facial images, and ii) attention level estimation of the students based on their eye blink frequency.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑