超越物理联系:人体姿态估计中的树模型
Beyond Physical Connections: Tree Models in Human Pose Estimation
摘要:
在过去的十年里,用于铰接对象的简单树模型盛行。然而,还认为这些简单的树模型不能够在许多场景中捕获大的变化,诸如人类姿势估计。本文试图解决三个问题:1)简单的树模型足够吗?2)如何有效地利用树模型进行人体姿态估计?(3)如何有效地利用组合件和单件?假设我们有一组单个部分和组合部分,目标是估计它们位置的联合分布。我们惊讶地发现,在Leeds Sport Dataset(LSP)中,在学习用于可变形模型的潜在树的过程中没有引入潜在变量,其目的是使用最小树结构来近似身体部位位置的关节分布。这表明可以直接使用单个和组合部分的混合表示来近似它们在简单树模型中的联合分布。因此,只需要构建组合部分的视觉类别,然后对学习的潜在树进行推理。我们的方法在LSP上的表现优于现有技术,无论是在训练图像来自同一数据集还是来自PARSE数据集的情况下。来自VOC挑战的动物图像实验进一步支持了我们的发现。
英文摘要:
Simple tree models for articulated objects prevails in the last decade. However, it is also believed that these simple tree models are not capable of capturing large variations in many scenarios, such as human pose estimation. This paper attempts to address three questions: 1) are simple tree models sufficient? more specifically, 2) how to use tree models effectively in human pose estimation? and 3) how shall we use combined parts together with single parts efficiently? Assuming we have a set of single parts and combined parts, and the goal is to estimate a joint distribution of their locations. We surprisingly find that no latent variables are introduced in the Leeds Sport Dataset (LSP) during learning latent trees for deformable model, which aims at approximating the joint distributions of body part locations using minimal tree structure. This suggests one can straightforwardly use a mixed representation of single and combined parts to approximate their joint distribution in a simple tree model. As such, one only needs to build Visual Categories of the combined parts, and then perform inference on the learned latent tree. Our method outperformed the state of the art on the LSP, both in the scenarios when the training images are from the same dataset and from the PARSE dataset. Experiments on animal images from the VOC challenge further support our findings.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。