协作学习环境中基于视频的快速人脸识别
Fast Video-based Face Recognition in Collaborative Learning Environments
摘要:
人脸识别是计算机视觉领域的一个经典问题,已经取得了重大进展。然而,在数字视频中,人脸识别由于遮挡、姿态和光照变化以及人进入/离开场景而变得复杂。本文的目标是开发一种适用于大数据集的数字视频中人脸识别的快速方法。本文介绍了几种解决视频人脸识别问题的方法。首先,为了解决与姿势和照明变化相关的问题,将面部原型的集合与每个学生相关联。其次,为了加快这个过程,使用采样、K均值聚类以及两者的组合来减少每个学生的人脸原型数量。第三,以不同的帧速率处理视频。第四,本文提出了使用活动集来解决遮挡和消除人脸识别应用程序的视频帧与缓慢的人脸运动。第五,本文开发了一个群体人脸检测器,它可以识别协作学习群体中的学生,同时拒绝群体外的人脸检测。第六,本文介绍了一种用于保护学生身份的人脸DeID。第七,本文使用数据扩充来增加训练集的规模。使用多目标优化将不同的方法组合在一起,以保证完整的方法保持快速而不牺牲精度。为了测试这种方法,论文开发了138个学生面孔(81个男孩和57个女孩)的年龄在10至14岁,主要是拉丁美洲/O学生的AOLME数据集。与基线方法相比,最终优化的方法导致快速识别时间,人脸识别准确率显着提高。仅使用人脸原型采样,所提出的方法实现了71.8%的准确率,而基线系统的准确率为62.3%,同时运行速度提高了11.6倍。
英文摘要:
Face recognition is a classical problem in Computer Vision that has experienced significant progress. Yet, in digital videos, face recognition is complicated by occlusion, pose and lighting variations, and persons entering/leaving the scene. The thesis's goal is to develop a fast method for face recognition in digital videos that is applicable to large datasets. The thesis introduces several methods to address the problems associated with video face recognition. First, to address issues associated with pose and lighting variations, a collection of face prototypes is associated with each student. Second, to speed up the process, sampling, K-means Clustering, and a combination of both are used to reduce the number of face prototypes per student. Third, the videos are processed at different frame rates. Fourth, the thesis proposes the use of active sets to address occlusion and to eliminate face recognition application on video frames with slow face motions. Fifth, the thesis develops a group face detector that recognizes students within a collaborative learning group, while rejecting out-of-group face detections. Sixth, the thesis introduces a face DeID for protecting the students' identities. Seventh, the thesis uses data augmentation to increase the training set's size. The different methods are combined using multi-objective optimization to guarantee that the full method remains fast without sacrificing accuracy. To test the approach, the thesis develops the AOLME dataset of 138 student faces (81 boys and 57 girls) of ages 10 to 14, who are predominantly Latina/o students. Compared to the baseline method, the final optimized method resulted in fast recognition times with significant improvements in face recognition accuracy. Using face prototype sampling only, the proposed method achieved an accuracy of 71.8% compared to 62.3% for the baseline system, while running 11.6 times faster.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。