发表机构
Donghua University; Shanghai Artificial Intelligence Laboratory（东华大学; 上海人工智能实验室）
机构由 AI 辅助整理，请以论文原文为准。AI 中文总结
研究针对3D服装生成难题，提出Fashion-3DLR框架，通过GFF-DiT模块融合2D时尚设计元素，利用整流流Transformer生成几何潜在值，实现多种3D服装表示，并集成到下游任务，实验证明其超越现有方法，有成为通用3D服装设计工具的潜力。
AI 中文摘要
人工智能生成内容（AIGC）取得显著进展，2D生成模型已成为数字时尚行业的可用工具，但3D服装生成仍处于起步阶段。时尚领域中多样设计元素的语义信息在3D表示中存在复杂耦合关系，给生成多样3D服装带来挑战。为此引入Fashion-3DLR框架，利用多样设计元素创建高质量、通用的3D服装资产。提出服装特征融合扩散Transformer（GFF-DiT）模块整合2D时尚设计元素到潜在空间，在潜在空间用整流流Transformer生成几何潜在值并解码为各种3D服装表示。还将其集成到下游任务实现3D高斯渲染驱动的布料物理模拟和基于网格的虚拟试穿。实验结果表明Fashion-3DLR超越先前方法，能生成结构良好、非水密且可进行物理模拟和虚拟试穿的服装，凸显其作为通用3D服装设计工具的潜力。
英文摘要
AI-generated content (AIGC) has made significant progress, with 2D generative models becoming ready-to-use tools for the digital fashion industry. However, 3D garment generation remains in its nascent stage, where in the realm of fashion, the semantic information of diverse design elements exhibits intricate coupling relationships in 3D representations, posing substantial challenges for generating diverse 3D garments. In this work, to handle the above problem, We introduce Fashion-3DLR, a novel 3D garment generation framework that utilizes diverse design elements to create high-quality, versatile 3D garment assets. Specifically, to bridge the semantic gaps between different fashion elements, we propose a Garment Feature Fusion Diffusion Transformer (GFF-DiT) module to integrate 2D fashion design elements, e.g., sketch and texture, into latent space. Within the latent space, we then employ a rectified flow transformer to generate geometry latents, which can be decoded into various 3D garment representations, including 3D Gaussians and meshes. Furthermore, we integrate Fashion-3DLR into downstream tasks, achieving the 3D Gaussian Splatting (3DGS)-driven cloth physical simulation and mesh-based virtual try-on. Experimental results indicate that Fashion-3DLR surpass the previous state-of-the-art methods, which verify that the proposed work can generate well-structured, non-watertight garments capable of physical simulation and virtual try-on, underscoring its potential as a versatile 3D garment design tool.
