arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2511.05844cs.CVcs.AIcs.ITcs.LGeess.IVmath.IT

通过校准和正则化增强扩散模型引导

Enhancing Diffusion Model Guidance through Calibration and Regularization

UC San Diego(加州大学圣迭戈分校);Politecnico di Milano(米兰理工学院)

Seyed Alireza Javid, Amirhossein Bagheri, Nuria González-Prelcic

AI总结:

本文通过校准和正则化方法提升扩散模型引导效果,改进分类器校准和采样策略,提升图像生成质量。

摘要:

分类引导的扩散模型已作为一种强大的方法出现,用于条件图像生成,但它们在早期去噪步骤中表现出过度自信的预测,导致引导梯度消失。本文介绍了两个互补的贡献来解决这个问题。首先,我们提出了一种基于平滑预期校准误差(Smooth ECE)的可微校准目标,该目标通过最小的微调改进分类器校准,并在Fréchet inception距离(FID)上产生可测量的改进。其次,我们开发了增强的采样引导方法,这些方法可以在无需重新训练的情况下操作现成的分类器。这些包括倾斜采样与批次层面的重新加权、自适应熵正则化采样以保持多样性,以及一种新的f-分歧度基于的采样策略,该策略在保持模式覆盖的同时加强了类一致的引导。在ImageNet 128x128上的实验表明,我们的分歧度正则化引导在使用ResNet-101分类器时实现了FID为2.13,优于现有的分类器引导扩散方法,且无需重新训练扩散模型。结果表明,原则性的校准和分歧度意识的采样为分类器引导扩散提供了实用且有效的改进。

英文摘要:

Classifier-guided diffusion models have emerged as a powerful approach for conditional image generation, but they suffer from overconfident predictions during early denoising steps, causing the guidance gradient to vanish. This paper introduces two complementary contributions to address this issue. First, we propose a differentiable calibration objective based on the Smooth Expected Calibration Error (Smooth ECE), which improves classifier calibration with minimal fine-tuning and yields measurable improvements in Frechet Inception Distance (FID). Second, we develop enhanced sampling guidance methods that operate on off-the-shelf classifiers without requiring retraining. These include tilted sampling with batch-level reweighting, adaptive entropy-regularized sampling to preserve diversity, and a novel f-divergence-based sampling strategy that strengthens class-consistent guidance while maintaining mode coverage. Experiments on ImageNet 128x128 demonstrate that our divergence-regularized guidance achieves an FID of 2.13 using a ResNet-101 classifier, improving upon existing classifier-guided diffusion methods while requiring no diffusion model retraining. The results show that principled calibration and divergence-aware sampling provide practical and effective improvements for classifier-guided diffusion.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑