ToMiE：面向复杂3D人体化身重建的显式外骨骼
ToMiE: Towards Explicit Exoskeleton for the Reconstruction of Complicated 3D Human Avatars
AI总结：
提出ToMiE方法，通过父关节定位和外部关节优化使SMPL骨架自适应扩展，解决手持物体和宽松衣物建模难题，提升渲染质量并支持显式动画。
摘要：
在本文中，我们强调了大多数3D人体任务中一个关键却常被忽视的因素，即对带有手持物体或穿着宽松衣物的复杂3D人体进行建模。众所周知，SMPL的参数化公式能够拟合人体皮肤；然而，手持物体和宽松衣物很难在统一框架内被建模，因为它们的运动通常与人体解耦。为了增强SMPL骨架应对这种情况的能力，我们提出了一种使骨架关节树能够自适应扩展的生长策略。具体而言，我们的方法名为ToMiE，包含父关节定位和外部关节优化。对于父关节定位，我们采用基于LBS混合权重和运动核引导的梯度方法。一旦获得外部关节，我们便继续优化它们在不同帧中SE(3)的变换，从而实现渲染和显式动画。ToMiE在带有手持物体和宽松衣物的各种场景中均优于其他方法，不仅在渲染质量上表现更好，还能提供生长关节的自由动画，从而增强了SMPL骨架在更广泛应用中的表达能力。
英文摘要：
In this paper, we highlight a critical yet often overlooked factor in most 3D human tasks, namely modeling complicated 3D human with with hand-held objects or loose-fitting clothing. It is known that the parameterized formulation of SMPL is able to fit human skin; while hand-held objects and loose-fitting clothing, are difficult to get modeled within the unified framework, since their movements are usually decoupled with the human body. To enhance the capability of SMPL skeleton in response to this situation, we propose a growth strategy that enables the joint tree of the skeleton to expand adaptively. Specifically, our method, called ToMiE, consists of parent joints localization and external joints optimization. For parent joints localization, we employ a gradient-based approach guided by both LBS blending weights and motion kernels. Once the external joints are obtained, we proceed to optimize their transformations in SE(3) across different frames, enabling rendering and explicit animation. ToMiE manages to outperform other methods across various cases with hand-held objects and loose-fitting clothing, not only in rendering quality but also by offering free animation of grown joints, thereby enhancing the expressive ability of SMPL skeleton for a broader range of applications.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
