基于视频记录的新生儿面部与面部关键点检测
Neonatal Face and Facial Landmark Detection from Video Recordings
AI总结:
针对新生儿健康评估需求,本文基于YOLOv7Face结合迁移学习、数据增强等技术,提出新生儿面部及关键点检测模型,在公开数据集上取得优于现有方法的性能,助力全自动新生儿健康评估算法开发。
摘要:
本文研究了新生儿面部及面部关键点的自动检测技术,这是众多基于视频的新生儿健康应用(如生命体征估计、疼痛评估、睡眠-觉醒分类和黄疸检测)的重要第一步。研究使用了三个临床环境下的公开新生儿数据集,分别标注了366张图像(258名受试者)用于训练、89张图像(66名受试者)用于测试。研究对两个基于YOLO的模型应用了迁移学习,每个训练轮次中输入训练图像会通过随机水平翻转、光度色彩失真、平移和缩放进行增强。此外,研究还探索了输入图像重定向和训练后深度学习模型融合的方法。本文提出的基于YOLOv7Face的模型性能优于现有方法,人脸检测平均精度均值达84.8%,面部关键点检测归一化平均误差为0.072。总体而言,该研究将助力全自动新生儿健康评估算法的开发。
英文摘要:
This paper explores automated face and facial landmark detection of neonates, which is an important first step in many video-based neonatal health applications, such as vital sign estimation, pain assessment, sleep-wake classification, and jaundice detection. Utilising three publicly available datasets of neonates in the clinical environment, 366 images (258 subjects) and 89 (66 subjects) were annotated for training and testing, respectively. Transfer learning was applied to two YOLO-based models, with input training images augmented with random horizontal flipping, photo-metric colour distortion, translation and scaling during each training epoch. Additionally, the re-orientation of input images and fusion of trained deep learning models was explored. Our proposed model based on YOLOv7Face outperformed existing methods with a mean average precision of 84.8% for face detection, and a normalised mean error of 0.072 for facial landmark detection. Overall, this will assist in the development of fully automated neonatal health assessment algorithms.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。