arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2212.07652cs.CV
收藏

基于扩展对象表示的人体部位关节检测与关联

Body-Part Joint Detection and Association via Extended Object Representation

Shanghai Jiao Tong University(上海交通大学)

Huayi Zhou, Fei Jiang, Hongtao Lu

摘要:

人体及其相关部位的检测(例如,面部、头部或手部)的神经网络已经被深入研究,并且自从深度CNN的突破以来得到了极大的改进。然而,这些检测器中的大多数都是独立训练的,这使得将检测到的身体部位与人相关联成为一项具有挑战性的任务。本文主要研究人体及其相应部位的关节检测问题。具体来说,我们提出了一种新的扩展对象表示,集成的中心位置偏移的身体或其部分,并构建了一个密集的单级锚为基础的身体部分关节检测器(BPJDet)。BPJDet中的人体部位关联被嵌入到包含语义和几何信息的统一表示中。因此,BPJDet不会遭受易出错的关联后匹配,并且具有更好的精度-速度权衡。此外,BPJDet可以无缝地推广到联合检测任何身体部位。为了验证我们的方法的有效性和优越性,我们进行了广泛的实验上CityPersons,CrowdHuman和BodyHands数据集。所提出的BPJDet检测器在这三个基准上实现了最先进的关联性能,同时保持了较高的检测精度。代码在https://github.com/hnuzhy/BPJDet中。

英文摘要:

The detection of human body and its related parts (e.g., face, head or hands) have been intensively studied and greatly improved since the breakthrough of deep CNNs. However, most of these detectors are trained independently, making it a challenging task to associate detected body parts with people. This paper focuses on the problem of joint detection of human body and its corresponding parts. Specifically, we propose a novel extended object representation that integrates the center location offsets of body or its parts, and construct a dense single-stage anchor-based Body-Part Joint Detector (BPJDet). Body-part associations in BPJDet are embedded into the unified representation which contains both the semantic and geometric information. Therefore, BPJDet does not suffer from error-prone association post-matching, and has a better accuracy-speed trade-off. Furthermore, BPJDet can be seamlessly generalized to jointly detect any body part. To verify the effectiveness and superiority of our method, we conduct extensive experiments on the CityPersons, CrowdHuman and BodyHands datasets. The proposed BPJDet detector achieves state-of-the-art association performance on these three benchmarks while maintains high accuracy of detection. Code is in https://github.com/hnuzhy/BPJDet.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑