克服3D手形重建中准确性与合理性之间的权衡
Overcoming the Trade-off Between Accuracy and Plausibility in 3D Hand Shape Reconstruction
AI总结:
针对3D手形重建中准确性与合理性难以兼顾的问题,提出端到端融合非参数网格拟合与MANO模型的弱监督框架,打破二者权衡,在双手、手物交互等场景下生成高精度且合理的3D手网格。
摘要:
用于3D手形重建的直接网格拟合方法准确性很高,但重建出的网格容易出现伪影,呈现的手形并不合理。相反,MANO这类参数化模型能保证手形合理,却达不到非参数化方法的精度。本研究提出一种新型弱监督手形估计框架,以端到端方式将非参数网格拟合与MANO模型相结合。我们的联合模型打破了准确性与合理性的权衡限制,可生成对齐良好的高质量3D网格,在具有挑战性的双手及手物交互场景中表现尤为突出。
英文摘要:
Direct mesh fitting for 3D hand shape reconstruction is highly accurate. However, the reconstructed meshes are prone to artifacts and do not appear as plausible hand shapes. Conversely, parametric models like MANO ensure plausible hand shapes but are not as accurate as the non-parametric methods. In this work, we introduce a novel weakly-supervised hand shape estimation framework that integrates non-parametric mesh fitting with MANO model in an end-to-end fashion. Our joint model overcomes the tradeoff in accuracy and plausibility to yield well-aligned and high-quality 3D meshes, especially in challenging two-hand and hand-object interaction scenarios.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。