arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1602.04124cs.CV
收藏

基于检测引导优化的快速鲁棒手部跟踪

Fast and Robust Hand Tracking Using Detection-Guided Optimization

Max Planck Institute for Informatics(马克斯·普朗克信息学研究所);Saarland University(萨尔大学);Aalto University(阿尔托大学)

Srinath Sridhar, Franziska Mueller, Antti Oulasvirta, Christian Theobalt

摘要:

手和手指的无标记跟踪是人机交互的一个有前途的使能者。然而,由于跟踪不准确、运动覆盖不完整、低帧率、复杂的相机设置和高计算要求,采用受到限制。在本文中,我们提出了一种快速的方法,准确地跟踪快速和复杂的关节的手使用一个单一的深度相机。我们的算法使用了一种新的检测引导优化策略,提高了姿态估计的鲁棒性和速度。在检测步骤中,随机决策森林将像素分类为手的部分。在优化步骤中,一个新的目标函数将检测到的部分标签和深度的高斯混合表示相结合,以估计最适合深度的姿势。我们的方法需要更少的计算资源,这使得它非常快(50 fps,没有GPU支持)。该方法还支持不同的静态或移动的相机到场景的布置。我们通过在公共数据集上进行评估并与以前的工作进行比较来展示我们的方法的好处。

英文摘要:

Markerless tracking of hands and fingers is a promising enabler for human-computer interaction. However, adoption has been limited because of tracking inaccuracies, incomplete coverage of motions, low framerate, complex camera setups, and high computational requirements. In this paper, we present a fast method for accurately tracking rapid and complex articulations of the hand using a single depth camera. Our algorithm uses a novel detection-guided optimization strategy that increases the robustness and speed of pose estimation. In the detection step, a randomized decision forest classifies pixels into parts of the hand. In the optimization step, a novel objective function combines the detected part labels and a Gaussian mixture representation of the depth to estimate a pose that best fits the depth. Our approach needs comparably less computational resources which makes it extremely fast (50 fps without GPU support). The approach also supports varying static, or moving, camera-to-scene arrangements. We show the benefits of our method by evaluating on public datasets and comparing against previous work.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑