Meta 3D Gen
Meta 3D Gen
摘要：
我们介绍了Meta 3D Gen（3DGen），这是一种用于文本到3D资产生成的新的最先进的快速管道。3DGen提供3D资产创建，具有高度的即时保真度和高质量的3D形状和纹理，在一分钟内。它支持基于物理的渲染（PBR），这是现实应用中3D资源重新照明所必需的。此外，3DGen支持使用用户提供的附加文本输入对先前生成的（或艺术家创建的）3D形状进行生成再纹理化。3DGen集成了关键的技术组件，Meta 3D AssetGen和Meta 3D TextureGen，我们分别为文本到3D和文本到纹理生成开发。通过结合它们的优势，3DGen同时以三种方式表示3D对象：在视图空间，体积空间和UV（或纹理）空间中。这两种技术的集成实现了相对于单阶段模型的68%的胜率。我们将3DGen与众多行业基准进行了比较，并表明它在复杂文本提示的提示保真度和视觉质量方面优于它们，同时速度明显更快。
英文摘要：
We introduce Meta 3D Gen (3DGen), a new state-of-the-art, fast pipeline for text-to-3D asset generation. 3DGen offers 3D asset creation with high prompt fidelity and high-quality 3D shapes and textures in under a minute. It supports physically-based rendering (PBR), necessary for 3D asset relighting in real-world applications. Additionally, 3DGen supports generative retexturing of previously generated (or artist-created) 3D shapes using additional textual inputs provided by the user. 3DGen integrates key technical components, Meta 3D AssetGen and Meta 3D TextureGen, that we developed for text-to-3D and text-to-texture generation, respectively. By combining their strengths, 3DGen represents 3D objects simultaneously in three ways: in view space, in volumetric space, and in UV (or texture) space. The integration of these two techniques achieves a win rate of 68% with respect to the single-stage model. We compare 3DGen to numerous industry baselines, and show that it outperforms them in terms of prompt fidelity and visual quality for complex textual prompts, while being significantly faster.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
