arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2302.00670cs.LGcs.CV
收藏

扩散模型中约简方差得分估计的稳定目标场

Stable Target Field for Reduced Variance Score Estimation in Diffusion Models

Massachusetts Institute of Technology(麻省理工学院)

Yilun Xu, Shangyuan Tong, Tommi Jaakkola

摘要:

扩散模型通过反转固定的正向扩散过程来生成样本。尽管已经提供了令人印象深刻的经验结果,这些扩散模型算法可以通过减少训练目标在其去噪得分匹配目标中的方差来进一步改进。我们认为,这种方差的来源在于处理的中间噪声方差尺度,在数据中的多个模式的影响方向的反向路径。我们建议通过引入一个参考批次来解决这个问题,我们使用该批次来计算加权条件得分作为更稳定的训练目标。我们表明,该程序确实有助于在具有挑战性的中间制度,减少(的痕迹)的协方差的训练目标。新的稳定目标可以被视为降低方差的交易偏倚,其中偏倚随着参考批量的增加而消失。从经验上讲,我们表明,新的目标提高了图像质量,稳定性和训练速度的各种流行的扩散模型跨数据集与一般的ODE和离散化求解器。当与EDM结合使用时,我们的方法在无条件CIFAR-10生成任务上产生了35个网络评估的1.90的当前SOTA FID。代码可在https://github.com/Newbeeer/stf上获得

英文摘要:

Diffusion models generate samples by reversing a fixed forward diffusion process. Despite already providing impressive empirical results, these diffusion models algorithms can be further improved by reducing the variance of the training targets in their denoising score-matching objective. We argue that the source of such variance lies in the handling of intermediate noise-variance scales, where multiple modes in the data affect the direction of reverse paths. We propose to remedy the problem by incorporating a reference batch which we use to calculate weighted conditional scores as more stable training targets. We show that the procedure indeed helps in the challenging intermediate regime by reducing (the trace of) the covariance of training targets. The new stable targets can be seen as trading bias for reduced variance, where the bias vanishes with increasing reference batch size. Empirically, we show that the new objective improves the image quality, stability, and training speed of various popular diffusion models across datasets with both general ODE and SDE solvers. When used in combination with EDM, our method yields a current SOTA FID of 1.90 with 35 network evaluations on the unconditional CIFAR-10 generation task. The code is available at https://github.com/Newbeeer/stf

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑