arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2603.25580cs.CV
收藏

UNIC:基于神经变形场的神经服装变形用于实时穿衣角色动画

UNIC: Neural Garment Deformation Field for Real-time Clothed Character Animation

HKUST(香港科技大学);Waseda(早稻田大学);MIT(麻省理工学院);CMU(卡内基梅隆大学);HKU(香港大学);NTU(南洋理工大学);TAMU(德克萨斯农工大学)

Chengfeng Zhao, Junbo Qi, Yulou Liu, Zhiyang Dou, Minchen Li, Taku Komura, Ziwei Liu, Wenping Wang, Yuan Liu

AI总结:

本文提出UNIC方法,通过实例特定的神经变形场实时动画角色服装,无需泛化到新服装,提升变形质量和训练效率。

摘要:

模拟物理真实的服装变形是虚拟沉浸体验的关键任务,通常通过物理模拟方法实现。然而,这些方法通常耗时、计算需求高且需要昂贵硬件,不适合实时应用。最近的学习方法尝试通过训练图神经网络学习顶点上的服装变形,但无法捕捉复杂服装网格的复杂拓扑变形。本文提出一种新的基于神经变形场的方法UNIC,通过实例特定的神经变形场实时动画角色服装。这种实例特定的学习方案不需要UNIC泛化到新服装,只需新运动序列,大大降低了训练难度并提高了变形质量。此外,神经变形场将3D点映射到变形偏移,不仅避免处理复杂服装的拓扑,还注入了自然的平滑约束。在各种服装网格上进行了大量实验,证明UNIC在基准方法上具有有效性和效率,使其在如视频游戏等现实交互应用中具有潜在的实用价值。

英文摘要:

Simulating physically realistic garment deformations is an essential task for virtual immersive experience, which is often achieved by physics simulation methods. However, these methods are typically time-consuming, computationally demanding, and require costly hardware, which is not suitable for real-time applications. Recent learning-based methods tried to resolve this problem by training graph neural networks to learn the garment deformation on vertices, which, however, fail to capture the intricate deformation of complex garment meshes with complex topologies. In this paper, we introduce a novel neural deformation field-based method, named UNIC, to animate the garments of an avatar in real time, given the motion sequences. Our key idea is to learn the instance-specific neural deformation field to animate the garment meshes. Such an instance-specific learning scheme does not require UNIC to generalize to new garments but only to new motion sequences, which greatly reduces the difficulty in training and improves the deformation quality. Moreover, neural deformation fields map the 3D points to their deformation offsets, which not only avoids handling topologies of the complex garments but also injects a natural smoothness constraint in the deformation learning. Extensive experiments have been conducted on various kinds of garment meshes to demonstrate the effectiveness and efficiency of UNIC over baseline methods, making it potentially practical and useful in real-world interactive applications like video games.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑