COMPOSE:用于多视角三维人体姿态估计的超图覆盖优化
COMPOSE: Hypergraph Cover Optimization for Multi-view 3D Human Pose Estimation
AI总结:
提出COMPOSE方法,将多视角三维人体姿态估计重构为超图上的加权精确覆盖优化,通过全局组合目标替代局部配对关联,结合几何剪枝与整数线性规划或信念传播求解器,无监督下精度提升显著。
摘要:
从稀疏多视角相机装置中进行三维人体姿态估计是众多应用(包括动作识别、体育分析和人机交互)的基本任务。尽管学习方法在基准测试中占据主导地位,但它们需要大量标注数据集;无训练的基于优化的方法仍然有前景,因为它们通过解决来自二维检测的跨视角对应问题来规避三维监督。现有的组合公式依赖配对关联来建模这一对应问题,并将跨视角的全局一致性仅作为下游约束来强制执行。然而,在遮挡和噪声检测下,调和局部合理的配对匹配变得脆弱,局部错误会全局传播。我们提出COMPOSE,它将多视角三维人体姿态估计重新定义为对人物假设超图上的加权精确覆盖优化。我们的公式用单个全局组合目标替代了配对关联和事后一致性强制执行。为了应对指数级大的候选空间,我们引入了一种几何剪枝策略以及两种互补的求解器:精确整数线性规划公式和通过信念传播的可扩展松弛。在没有任何三维监督的情况下,COMPOSE在平均精度上比最佳基于优化的方法提高了31个百分点,比自监督学习方法提高了13个百分点,证明了高阶组合关联在无训练的多视角三维人体姿态估计中的有效性。
英文摘要:
3D human pose estimation from sparse multi-view camera rigs is an essential task for numerous applications, including action recognition, sports analysis, and human-robot interaction. While learned methods dominate the field on benchmarks, they require large annotated datasets; training-free optimization-based methods remain promising as they circumvent 3D supervision by solving a correspondence problem across views from 2D detections. Existing combinatorial formulations rely on pairwise associations to model this correspondence problem and enforce global consistency across views only as a downstream constraint. However, reconciling locally plausible pairwise matches becomes brittle under occlusion and noisy detections, where local errors propagate globally. We propose COMPOSE, which recasts multi-view 3D human pose estimation as a weighted exact-cover optimization over a hypergraph of person hypotheses. Our formulation replaces pairwise association and post-hoc consistency enforcement with a single global combinatorial objective. To address the exponentially large candidate space, we introduce a geometric pruning strategy alongside two complementary solvers: an exact Integer Linear Programming formulation and a scalable relaxation via Belief Propagation. Without any 3D supervision, COMPOSE improves average precision by up to 31 points over the best optimization-based method and 13 points over self-supervised learned methods, demonstrating the effectiveness of higher-order combinatorial association for training-free multi-view 3D human pose estimation.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。