arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2111.00538cs.CV
收藏

从面部到步态:步行模式性别信息的弱监督学习

From Face to Gait: Weakly-Supervised Learning of Gender Information from Walking Patterns

University Politehnica of Bucharest(布加勒斯特理工大学)

Andy Catruna, Adrian Cosma, Ion Emilian Radoi

摘要:

从视频中获取人口统计信息对于一系列现实世界的应用是有价值的。虽然利用面部特征进行性别推断的方法在受约束的环境中非常成功,但在大多数现实场景中,当主体不面对相机时,由于与相机的距离或分辨率差,面部被遮挡或面部不清晰时,它们不起作用。我们提出了一种弱监督的方法来学习性别信息的人的基础上,他们的行走方式。我们利用最先进的面部分析模型来自动注释正视行走序列,并通过利用基于步态的标签传播来概括看不见的角度。我们的研究结果显示,F1得分为91%的面部分析模型具有同等或更高的性能,并且能够成功地推广到由于受试者不面对相机或面部被遮挡而无法进行面部分析的场景。

英文摘要:

Obtaining demographics information from video is valuable for a range of real-world applications. While approaches that leverage facial features for gender inference are very successful in restrained environments, they do not work in most real-world scenarios when the subject is not facing the camera, has the face obstructed or the face is not clear due to distance from the camera or poor resolution. We propose a weakly-supervised method for learning gender information of people based on their manner of walking. We make use of state-of-the art facial analysis models to automatically annotate front-view walking sequences and generalise to unseen angles by leveraging gait-based label propagation. Our results show on par or higher performance with facial analysis models with an F1 score of 91% and the ability to successfully generalise to scenarios in which facial analysis is unfeasible due to subjects not facing the camera or having the face obstructed.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑