arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2406.11202cs.CVcs.GR
收藏

Consistency²:使用潜在一致性模型实现一致且快速的3D绘制

Consistency^2: Consistent and Fast 3D Painting with Latent Consistency Models

ETH Zurich(苏黎世联邦理工学院)

Tianfu Wang, Anton Obukhov, Konrad Schindler

AI总结:

针对扩散式3D绘制采样耗时且2D加速技术难以迁移的问题,本文提出LCM的3D适配方法,并在Objaverse上取得更优的定量与定性评价。

摘要:

生成式3D绘制是高分辨率3D资产管理与回收领域最能提升生产力的技术之一。自从文本到图像模型能够在消费级硬件上进行推理以来,3D绘制方法的性能持续提升,目前已接近停滞期。大多数此类模型的核心是潜在空间中的去噪扩散,这本质上是一个耗时的迭代过程。近期研究人员开发了多种技术来加速生成,并将采样迭代次数减少数个数量级。这些技术是为2D生成式成像设计的,并未提供将其提升至3D的方案。本文中,我们通过针对当前任务提出一种潜在一致性模型(LCM)适配方法来解决这一缺陷。我们分析了所提模型的优势与弱点,并对其进行定量和定性评估。基于Objaverse数据集样本的研究,我们的3D绘制方法在所有评估中都获得了强烈偏好。源代码可在https://github.com/kongdai123/consistency2获取。

英文摘要:

Generative 3D Painting is among the top productivity boosters in high-resolution 3D asset management and recycling. Ever since text-to-image models became accessible for inference on consumer hardware, the performance of 3D Painting methods has consistently improved and is currently close to plateauing. At the core of most such models lies denoising diffusion in the latent space, an inherently time-consuming iterative process. Multiple techniques have been developed recently to accelerate generation and reduce sampling iterations by orders of magnitude. Designed for 2D generative imaging, these techniques do not come with recipes for lifting them into 3D. In this paper, we address this shortcoming by proposing a Latent Consistency Model (LCM) adaptation for the task at hand. We analyze the strengths and weaknesses of the proposed model and evaluate it quantitatively and qualitatively. Based on the Objaverse dataset samples study, our 3D painting method attains strong preference in all evaluations. Source code is available at https://github.com/kongdai123/consistency2.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑