arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2110.04447cs.CVcs.AIcs.HC
收藏

EfficientPhys:实现简单、快速、准确的基于相机的生命体征测量

EfficientPhys: Enabling Simple, Fast and Accurate Camera-Based Vitals Measurement

University of Washington(华盛顿大学);University of California Los Angeles(加州大学洛杉矶分校);Microsoft Research(微软研究院)

Xin Liu, Brian L. Hill, Ziheng Jiang, Shwetak Patel, Daniel McDuff

摘要:

基于相机的生理测量是一个不断发展的领域,神经模型提供最先进的性能。先前的研究已经探索了各种“端到端”模型;然而,这些方法仍然需要几个预处理步骤。这些额外的操作往往是不平凡的实现,使复制和部署困难,甚至可以有一个更高的计算预算比“核心”网络本身。在本文中,我们提出了两种新颖高效的神经模型,用于基于摄像头的生理测量,称为EfficientPhys,无需进行人脸检测,分割,归一化,颜色空间变换或任何其他预处理步骤。使用原始视频帧的输入,我们的模型在三个公共数据集上实现了强大的性能。我们表明,无论是使用Transformer还是卷积骨干,情况都是如此。我们进一步评估了所提出的网络的延迟,并表明我们最轻的网络也实现了33%的效率提高。

英文摘要:

Camera-based physiological measurement is a growing field with neural models providing state-the-art-performance. Prior research have explored various "end-to-end" models; however these methods still require several preprocessing steps. These additional operations are often non-trivial to implement making replication and deployment difficult and can even have a higher computational budget than the "core" network itself. In this paper, we propose two novel and efficient neural models for camera-based physiological measurement called EfficientPhys that remove the need for face detection, segmentation, normalization, color space transformation or any other preprocessing steps. Using an input of raw video frames, our models achieve strong performance on three public datasets. We show that this is the case whether using a transformer or convolutional backbone. We further evaluate the latency of the proposed networks and show that our most light weight network also achieves a 33% improvement in efficiency.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑