通过流形感知 Transformer 实现神经服装动力学
Neural Garment Dynamics via Manifold-Aware Transformers
AI总结:
本文提出利用局部服装—身体碰撞驱动变形,并结合与网格无关的服装表示和流形感知 Transformer,实现对未见服装与人体几何的动力学泛化。
摘要:
用于建模动态服装的数据驱动和基于学习的解决方案已取得显著进展,尤其是在数字人场景中。然而,现有方法通常聚焦于相对于固定参数化人体模型来建模服装,并且仅限于训练期间见过的服装几何形状。在本文中,我们采用不同的方法,通过利用服装与其下方人体之间的局部相互作用来建模服装动力学。具体而言,随着身体运动,我们检测局部的服装—身体碰撞,并以此驱动服装变形。我们方法的核心是一种与网格无关的服装表示和一种流形感知 transformer 网络设计,二者共同使我们的方法能够泛化到未见过的服装和身体几何形状。我们在多种服装类型和运动序列上评估了该方法,并相对于当前最先进技术给出了具有竞争力的定性与定量结果。
英文摘要:
Data driven and learning based solutions for modeling dynamic garments have significantly advanced, especially in the context of digital humans. However, existing approaches often focus on modeling garments with respect to a fixed parametric human body model and are limited to garment geometries that were seen during training. In this work, we take a different approach and model the dynamics of a garment by exploiting its local interactions with the underlying human body. Specifically, as the body moves, we detect local garment-body collisions, which drive the deformation of the garment. At the core of our approach is a mesh-agnostic garment representation and a manifold-aware transformer network design, which together enable our method to generalize to unseen garment and body geometries. We evaluate our approach on a wide variety of garment types and motion sequences and provide competitive qualitative and quantitative results with respect to the state of the art.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。