arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2101.04096cs.CVcs.HCeess.IV
收藏

有面罩时的远程脉搏估计

Remote Pulse Estimation in the Presence of Face Masks

University of Notre Dame(圣母大学)

Jeremy Speth, Nathan Vance, Patrick Flynn, Kevin Bowyer, Adam Czajka

摘要:

远程光电体积描记术(rPPG)是一种用于监测血容量变化的技术,对于使用来自消费级可见光相机的面部视频进行广泛的非接触式健康监测可能特别有用。COVID-19疫情导致防护口罩的广泛使用。我们发现,布面罩的遮挡增加了心率估计的平均绝对误差超过80%时,部署的方法设计在未蒙面的脸。我们表明,通过添加图案化的合成面罩来增强未掩蔽的人脸视频,迫使模型关注眼周和前额区域,从而提高性能并缩小掩蔽和未掩蔽脉冲估计之间的差距。据我们所知,这篇论文是第一篇分析口罩对脉搏估计准确性的影响的论文,并提供了几个新的贡献:(a)设计用于在存在面罩的情况下进行远程光电体积描记术的基于3D CNN的方法,(b)从86名未设盲和61名设盲受试者获得的两个公开可用的脉搏估计数据集,(c)手工算法和3D CNN的评估,所述3D CNN在未掩蔽的面部的视频上训练并且具有合成添加的掩模,以及(d)将合成掩模添加到面部视频的数据增强方法。

英文摘要:

Remote photoplethysmography (rPPG), a family of techniques for monitoring blood volume changes, may be especially useful for widespread contactless health monitoring using face video from consumer-grade visible-light cameras. The COVID-19 pandemic has caused the widespread use of protective face masks. We found that occlusions from cloth face masks increased the mean absolute error of heart rate estimation by more than 80\% when deploying methods designed on unmasked faces. We show that augmenting unmasked face videos by adding patterned synthetic face masks forces the model to attend to the periocular and forehead regions, improving performance and closing the gap between masked and unmasked pulse estimation. To our knowledge, this paper is the first to analyse the impact of face masks on the accuracy of pulse estimation and offers several novel contributions: (a) 3D CNN-based method designed for remote photoplethysmography in a presence of face masks, (b) two publicly available pulse estimation datasets acquired from 86 unmasked and 61 masked subjects, (c) evaluations of handcrafted algorithms and a 3D CNN trained on videos of unmasked faces and with masks synthetically added, and (d) data augmentation method to add a synthetic mask to a face video.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑