高斯服装:用于自由形式虚拟试穿的组合式3D高斯虚拟人物
Gaussian Wardrobe: Compositional 3D Gaussian Avatars for Free-Form Virtual Try-On
AI总结:
Gaussian Wardrobe通过组合式3D高斯表示,实现从多视角视频中生成高保真虚拟人物,并支持自由形式服装的跨个体重用,提升虚拟试穿的实用性
摘要:
我们介绍了一个名为Gaussian Wardrobe的新框架,用于从多视角视频中数字化组合式3D神经虚拟人物。现有方法将人体和服装视为不可分割的整体,然而这种范式无法捕捉复杂自由形式服装的动态特性,并限制了服装在不同个体之间的重用。为了解决这些问题,我们开发了一种新颖的、组合式的3D高斯表示方法,用于从多层自由形式服装中构建虚拟人物。我们的方法核心是将神经虚拟人物分解为身体和形状无关的神经服装层。为了实现这一目标,我们的框架学习将每层服装从多视角视频中解耦,并将其标准化为形状无关的空间。在实验中,我们的方法能够以高保真的动态特性建模逼真的虚拟人物,在新的姿态合成基准测试中实现了新的最先进的性能。此外,我们证明所学习的组合式服装有助于一个多功能的数字衣柜,使服装能够自由地转移到新的人物上,从而实现一个实用的虚拟试穿应用。项目页面:https://ait.ethz.ch/gaussianwardrobe
英文摘要:
We introduce Gaussian Wardrobe, a novel framework to digitalize compositional 3D neural avatars from multi-view videos. Existing methods for 3D neural avatars typically treat the human body and clothing as an inseparable entity. However, this paradigm fails to capture the dynamics of complex free-form garments and limits the reuse of clothing across different individuals. To overcome these problems, we develop a novel, compositional 3D Gaussian representation to build avatars from multiple layers of free-form garments. The core of our method is decomposing neural avatars into bodies and layers of shape-agnostic neural garments. To achieve this, our framework learns to disentangle each garment layer from multi-view videos and canonicalizes it into a shape-independent space. In experiments, our method models photorealistic avatars with high-fidelity dynamics, achieving new state-of-the-art performance on novel pose synthesis benchmarks. In addition, we demonstrate that the learned compositional garments contribute to a versatile digital wardrobe, enabling a practical virtual try-on application where clothing can be freely transferred to new subjects. Project page: https://ait.ethz.ch/gaussianwardrobe
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。