arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2108.07181cs.CV
收藏

用于硬三维位姿估计的学习Skeleton图神经网络

Learning Skeletal Graph Neural Networks for Hard 3D Pose Estimation

The Chinese University of Hong Kong(香港中文大学);Microsoft Research Asia(微软亚洲研究院);Sensetime Group Ltd.(商汤集团有限公司)

Ailing Zeng, Xiao Sun, Lei Yang, Nanxuan Zhao, Minhao Liu, Qiang Xu

摘要:

已经提出了各种深度学习技术来解决单视图2D到3D姿态估计问题。虽然多年来平均预测精度已经显著提高,但对具有深度模糊、自遮挡和复杂或罕见姿势的硬姿势的性能仍然远远不能令人满意。在这项工作中,我们针对这些硬姿势,并提出了一种新的骨架GNN学习解决方案。具体来说,我们提出了一个跳感知的分层信道压缩融合层,以有效地从相邻节点中提取相关信息,同时抑制GNN学习中的不期望噪声。此外,我们提出了一个时间感知的动态图的建设过程,是强大的和有效的三维姿态估计。在Human3.6M数据集上的实验结果表明,该方法的预测精度平均提高了10.3%,并且在硬姿态上的预测精度也比现有技术有了很大的提高.我们进一步将所提出的技术应用于基于机器人的动作识别任务,并实现了最先进的性能。我们的代码可在https://github.com/ailingzengzzz/Skeletal-GNN上获得。

英文摘要:

Various deep learning techniques have been proposed to solve the single-view 2D-to-3D pose estimation problem. While the average prediction accuracy has been improved significantly over the years, the performance on hard poses with depth ambiguity, self-occlusion, and complex or rare poses is still far from satisfactory. In this work, we target these hard poses and present a novel skeletal GNN learning solution. To be specific, we propose a hop-aware hierarchical channel-squeezing fusion layer to effectively extract relevant information from neighboring nodes while suppressing undesired noises in GNN learning. In addition, we propose a temporal-aware dynamic graph construction procedure that is robust and effective for 3D pose estimation. Experimental results on the Human3.6M dataset show that our solution achieves 10.3\% average prediction accuracy improvement and greatly improves on hard poses over state-of-the-art techniques. We further apply the proposed technique on the skeleton-based action recognition task and also achieve state-of-the-art performance. Our code is available at https://github.com/ailingzengzzz/Skeletal-GNN.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑