基于逆热耗散的生成建模
Generative Modelling With Inverse Heat Dissipation
AI总结:
本文提出一种通过随机逆转热方程生成图像的新模型,利用图像多尺度结构实现由粗到细的生成,并展现出颜色与形状解耦等优于标准扩散模型的特性。
摘要:
尽管扩散模型在图像生成中取得了巨大成功,但其噪声逆变换的生成过程并未显式考虑图像的结构,例如其固有的多尺度特性。受扩散模型和由粗到细建模经验性成功的启发,我们提出了一种新的类扩散模型,该模型通过随机逆转热方程来生成图像。热方程是一种偏微分方程(PDE),当其在图像的二维平面上运行时,会在局部抹除细尺度信息。我们将具有恒定加性噪声的前向热方程的解解释为扩散潜变量模型中的变分近似。我们的新模型展现出标准扩散模型中未见的涌现定性特性,例如图像中整体颜色与形状的解耦。对自然图像的谱分析突显了其与扩散模型的联系,并揭示了其中隐式的由粗到细的归纳偏置。
英文摘要:
While diffusion models have shown great success in image generation, their noise-inverting generative process does not explicitly consider the structure of images, such as their inherent multi-scale nature. Inspired by diffusion models and the empirical success of coarse-to-fine modelling, we propose a new diffusion-like model that generates images through stochastically reversing the heat equation, a PDE that locally erases fine-scale information when run over the 2D plane of the image. We interpret the solution of the forward heat equation with constant additive noise as a variational approximation in the diffusion latent variable model. Our new model shows emergent qualitative properties not seen in standard diffusion models, such as disentanglement of overall colour and shape in images. Spectral analysis on natural images highlights connections to diffusion models and reveals an implicit coarse-to-fine inductive bias in them.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。