arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.23951cs.CV
收藏

AHAP:利用几何先验重建任意视角下的任意人类

AHAP: Reconstructing Arbitrary Humans from Arbitrary Perspectives with Geometric Priors

Xiaozhen Qiao, Wenjia Wang, Zhiyuan Zhao, Jiacheng Sun, Ping Luo, Hongyuan Zhang, Xuelong Li

AI总结:

AHAP通过融合多视角几何信息,实现无需相机标定的任意视角人类重建,提升了在现实场景中的适用性和效率。

摘要:

从多视角图像中重建3D人类通常需要预校准,如使用棋盘或MVS算法,这限制了在多样现实场景中的可扩展性和适用性。本文提出AHAP(从任意视角重建任意人类),是一种无需相机校准的前馈框架,用于从任意摄像机视角重建任意人类。我们的核心在于有效融合多视角几何以协助人类关联、重建和定位。具体而言,我们使用跨视角身份关联模块,通过可学习的人体查询和软分配,受对比学习监督,解决跨视角人类身份关联。人体头部模块融合跨视角特征和场景上下文以进行SMPL预测,受跨视角重投影损失引导以强制身体姿态一致性。此外,多视角几何消除了单目方法固有的深度模糊性,通过多视角三角化提供更精确的3D人体定位。在EgoHumans和EgoExo4D上的实验表明,AHAP在世界空间人体重建和摄像机姿态估计上实现了具有竞争力的性能,同时比基于优化的方法快180倍。

英文摘要:

Reconstructing 3D humans from images captured at multiple perspectives typically requires pre-calibration, like using checkerboards or MVS algorithms, which limits scalability and applicability in diverse real-world scenarios. In this work, we present AHAP (Reconstructing Arbitrary Humans from Arbitrary Perspectives), a feed-forward framework for reconstructing arbitrary humans from arbitrary camera perspectives without requiring camera calibration. Our core lies in the effective fusion of multi-view geometry to assist human association, reconstruction and localization. Specifically, we use a Cross-View Identity Association module through learnable person queries and soft assignment, supervised by contrastive learning to resolve cross-view human identity association. A Human Head fuses cross-view features and scene context for SMPL prediction, guided by cross-view reprojection losses to enforce body pose consistency. Additionally, multi-view geometry eliminates the depth ambiguity inherent in monocular methods, providing more precise 3D human localization through multi-view triangulation. Experiments on EgoHumans and EgoExo4D demonstrate that AHAP achieves competitive performance on both world-space human reconstruction and camera pose estimation, while being 180$\times$ faster than optimization-based approaches.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑