D-Garment: Physically Grounded Latent Diffusion for Dynamic Garment Deformations
Inria Centre at the University Grenoble Alpes(格勒诺布尔阿尔卑斯大学Inria研究中心);Inria, University of Rennes, CNRS, IRISA-UMR 6074(雷恩大学Inria、CNRS、IRISA-UMR 6074);InterDigital Inc.(InterDigital公司)
Antoine Dumoulin, Adnane Boukhayma, Laurence Boissieux, Bharath Bhushan Damodaran, Pierre Hellier, Stefanie Wuhrer
We present a method to dynamically deform 3D garments, in the form of a 3D polygon mesh, based on body shape, motion, and physical cloth material properties. Considering physical cloth properties allows to learn a physically grounded model, with the advantage of being more accurate in terms of physically inspired metrics such as strain or curvature. Existing work studies pose-dependent garment modeling to generate garment deformations from example data, and possibly data-driven dynamic cloth simulation to generate realistic garments in motion. We propose D-Garment, a learning-based approach trained on new data generated with a physics-based simulator. Compared to prior work, our 3D generative model learns garment deformations conditioned by physical material properties, which allows to model loose cloth geometry, especially for large deformations and dynamic wrinkles driven by body motion. Furthermore, the model can be efficiently fitted to observations captured using vision sensors such as 3D point clouds. We leverage the capability of diffusion models to learn flexible and powerful generative priors by modeling the 3D garment in a 2D parameter space independently from the mesh resolution. This representation allows to learn a template-specific latent diffusion model. This allows to condition global and local geometry with body and cloth material information. We quantitatively and qualitatively evaluate D-Garment on both simulations and data captured with a multi-view acquisition platform. Compared to recent baselines, our method is more realistic and accurate in terms of shape similarity and physical validity metrics. Code and data are available for research purposes at https://dumoulina.github.io/d-garment/
Zhejiang University(浙江大学);Shanghai Innovation Institute(上海创新研究院);Westlake University(西湖大学);University of Texas at Austin(德克萨斯大学奥斯汀分校);Fudan University(复旦大学)
Physically-Grounded Manifold Projection Model for Generalizable Metal Artifact Reduction in Dental CBCT
School of Cyberspace, Hangzhou Dianzi University(电子科技大学信息学院);Innovation Center for Electronic Design Automation Technology, Hangzhou Dianzi University(电子科技大学电子设计自动化创新中心);Hangzhou Geriatric Stomatology Hospital, Hangzhou Dental Hospital Group(杭州老年口腔医院,杭州口腔医院集团);School of Computing and Mathematical Sciences, University of Leicester(莱斯特大学计算与数学科学学院)
DPDEdit: Detail-Preserved Diffusion Models for Multimodal Fashion Image Editing
Shenzhen Technology University(深圳科技大学);University of Washington(华盛顿大学);Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences(深圳先进技术研究院,中国科学院)
PhysPlan: Grounded Physical State Reasoning and Graph-Guided Optimization for Physically Plausible Video Generation
University of Science, Ho Chi Minh City(胡志明市理科大学);Vietnam National University, Ho Chi Minh City(越南国立大学胡志明市分校);Monash University(莫纳什大学);University of Dayton(代顿大学)
Phase-aware video generation for physics-grounded dynamics and interactions
School of Computer Science, Nanjing University(南京大学计算机科学学院);Artificial Intelligence Research Institute, Shenzhen University of Advanced Technology(深圳理工大学人工智能研究院);SenseTime(商汤科技);Shenzhen Technology University(深圳技术大学)
DiT-Garment: Garment Dynamics with Diffusion Transformers
Inria Centre at the University Grenoble Alpes(格勒诺布尔阿尔卑斯大学Inria中心);InterDigital Inc.(InterDigital公司);Inria, University of Rennes, CNRS, IRISA-UMR 6074(Inria、雷恩大学、法国国家科学研究中心、IRISA-UMR 6074)
Learning Physics-Grounded 4D Dynamics with Neural Gaussian Force Fields
Institute for AI, Peking University(北京大学人工智能研究院);School of Psychological and Cognitive Sciences, Peking University(北京大学心理学与认知科学学院);School of EECS, Peking University(北京大学电子工程学院);Department of Automation, Tsinghua University(清华大学自动化系);Yuanpei College, Peking University(北京大学元培学院);State Key Lab of General AI, Peking University(北京大学通用人工智能国家重点实验室);Beijing Key Laboratory of Behavior and Mental Health, Peking University(北京行为与心理健康重点实验室)
DAMA: Disentangled Body-Anchored Gaussians for Controllable Multi-Layered Avatars
University of Tübingen(图宾根大学);Tübingen AI Center(图宾根人工智能中心);Max Planck Institute for Intelligent Systems(马克斯·普朗克智能系统研究所);Max Planck Institute for Informatics(马克斯·普朗克信息研究所);Zuse School ELIZA(祖斯学校ELIZA)
CNRS(法国国家科学研究中心);Université Claude Bernard Lyon 1(里昂第一大学);INSA Lyon(里昂国立应用科学学院);École Centrale de Lyon(里昂中央理工学院);Université Lumière Lyon 2(里昂第二大学);LIRIS UMR5205(里昂信息与系统科学研究院)
Physically Realistic Sequence-Level Adversarial Clothing for Robust Human-Detection Evasion
School of Future Technology, South China University of Technology(未来技术学院,华南理工大学);Institute for Interdisciplinary Information Sciences, Tsinghua University(交叉信息研究院,清华大学)
Physics-Grounded Motion Forecasting via Equation Discovery for Trajectory-Guided Image-to-Video Generation
Monash University(墨尔本大学);Harbin Institute of Technology(哈尔滨工业大学);Institute for Clarity in Documentation(文档清晰研究所);Inria Paris-Rocquencourt(巴黎-罗quentcourt研究所);Rajiv Gandhi University(拉朱·甘地大学);Tsinghua University(清华大学);Palmer Research Laboratories(帕勒尔研究实验室)
PrismGS: Physically-Grounded Anti-Aliasing for High-Fidelity Large-Scale 3D Gaussian Splatting
School of Information Science and Electronic Engineering, Shanghai Jiao Tong University, Shanghai, China(上海交通大学信息科学与电子工程学院);Cooperative Mediant Innovation Center, Shanghai Jiao Tong University, Shanghai, China(上海交通大学协同创新中心);College of Information Science and Technology, Eastern Institute of Technology, Ningbo, China(宁波工程技术学院信息科学与技术学院)
PrismGS提出物理基础正则化框架,通过金字塔多尺度监督和尺寸下界约束,解决大规模3DGS在高分辨率下的锯齿与闪烁问题,实现即插即用,在多个城市数据集上较CityGaussian提升约1.5 dB PSNR。