CogView3:通过中继扩散实现更精细更快速的文本生成图像
CogView3: Finer and Faster Text-to-Image Generation via Relay Diffusion
AI总结:
针对单阶段文本生成图像扩散模型效率低、细节差的问题,提出采用中继扩散的级联框架CogView3,性能优于SDXL且推理成本更低。
摘要:
文本生成图像系统的近期进展很大程度上由扩散模型推动,但单阶段文本生成图像扩散模型在计算效率和图像细节细化方面仍面临挑战。为解决该问题,我们提出CogView3,这是一种提升文本生成图像扩散性能的创新级联框架。CogView3是首个在文本生成图像领域实现中继扩散的模型,通过先生成低分辨率图像、再应用基于中继的超分辨率来执行任务。该方法不仅能产出具有竞争力的文本生成图像结果,还大幅降低了训练和推理成本。实验结果表明,CogView3在人类评估中比当前最先进的开源文本生成图像扩散模型SDXL高出77.0%,同时仅需约1/2的推理时间。CogView3的蒸馏变体仅使用SDXL 1/10的推理时间就达到了相当的性能。
英文摘要:
Recent advancements in text-to-image generative systems have been largely driven by diffusion models. However, single-stage text-to-image diffusion models still face challenges, in terms of computational efficiency and the refinement of image details. To tackle the issue, we propose CogView3, an innovative cascaded framework that enhances the performance of text-to-image diffusion. CogView3 is the first model implementing relay diffusion in the realm of text-to-image generation, executing the task by first creating low-resolution images and subsequently applying relay-based super-resolution. This methodology not only results in competitive text-to-image outputs but also greatly reduces both training and inference costs. Our experimental results demonstrate that CogView3 outperforms SDXL, the current state-of-the-art open-source text-to-image diffusion model, by 77.0\% in human evaluations, all while requiring only about 1/2 of the inference time. The distilled variant of CogView3 achieves comparable performance while only utilizing 1/10 of the inference time by SDXL.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。