arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2504.03468cs.CV
收藏

D-Garment:基于物理的潜在扩散模型用于动态服装变形

D-Garment: Physically Grounded Latent Diffusion for Dynamic Garment Deformations

Inria Centre at the University Grenoble Alpes(格勒诺布尔阿尔卑斯大学Inria研究中心);Inria, University of Rennes, CNRS, IRISA-UMR 6074(雷恩大学Inria、CNRS、IRISA-UMR 6074);InterDigital Inc.(InterDigital公司)

Antoine Dumoulin, Adnane Boukhayma, Laurence Boissieux, Bharath Bhushan Damodaran, Pierre Hellier, Stefanie Wuhrer

AI总结:

本文提出D-Garment,通过基于物理的模拟器生成新数据,学习基于物理材料属性的3D生成模型,实现更准确的服装变形和动态皱纹模拟。

摘要:

我们提出了一种方法,通过基于身体形状、运动和物理布料材料属性,动态变形3D服装(以3D多边形网格形式)。考虑物理布料属性可以学习一个基于物理的模型,其优势在于在诸如应变或曲率等物理启发式指标上更准确。现有工作研究了姿势依赖的服装建模,从示例数据生成服装变形,以及可能的数据驱动动态布料模拟,以生成运动中的逼真服装。我们提出D-Garment,一种基于学习的方法,通过基于物理的模拟器生成新数据进行训练。与先前工作相比,我们的3D生成模型学习了受物理材料属性条件的服装变形,这使得能够建模松散的布料几何形状,特别是对于大变形和由身体运动驱动的动态皱纹。此外,该模型可以高效地拟合到通过视觉传感器(如3D点云)捕获的观测数据。我们利用扩散模型的能力,通过在独立于网格分辨率的2D参数空间中建模3D服装,学习灵活且强大的生成先验。这种表示允许学习特定模板的潜在扩散模型。这允许根据身体和布料材料信息进行全局和局部几何条件。我们在模拟和多视角采集平台捕获的数据上对D-Garment进行了定性和定量评估。与最近的基线相比,我们的方法在形状相似性和物理有效性指标上更真实和准确。代码和数据可供研究目的使用,网址为https://dumoulina.github.io/d-garment/

英文摘要:

We present a method to dynamically deform 3D garments, in the form of a 3D polygon mesh, based on body shape, motion, and physical cloth material properties. Considering physical cloth properties allows to learn a physically grounded model, with the advantage of being more accurate in terms of physically inspired metrics such as strain or curvature. Existing work studies pose-dependent garment modeling to generate garment deformations from example data, and possibly data-driven dynamic cloth simulation to generate realistic garments in motion. We propose D-Garment, a learning-based approach trained on new data generated with a physics-based simulator. Compared to prior work, our 3D generative model learns garment deformations conditioned by physical material properties, which allows to model loose cloth geometry, especially for large deformations and dynamic wrinkles driven by body motion. Furthermore, the model can be efficiently fitted to observations captured using vision sensors such as 3D point clouds. We leverage the capability of diffusion models to learn flexible and powerful generative priors by modeling the 3D garment in a 2D parameter space independently from the mesh resolution. This representation allows to learn a template-specific latent diffusion model. This allows to condition global and local geometry with body and cloth material information. We quantitatively and qualitatively evaluate D-Garment on both simulations and data captured with a multi-view acquisition platform. Compared to recent baselines, our method is more realistic and accurate in terms of shape similarity and physical validity metrics. Code and data are available for research purposes at https://dumoulina.github.io/d-garment/

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑