arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2604.26348cs.CVcs.AI

ACPO:基于锚点的感知优化用于无参考质量引导的扩散模型

ACPO: Anchor-Constrained Perceptual Optimization for Diffusion Models with No-Reference Quality Guidance

School of Electronic and Information Engineering, Anhui University(安徽大学电子与信息工程学院);Institute of Artificial Intelligence, Hefei Comprehensive National Science Center(合肥国家综合科学中心人工智能研究院);School of Cyber Science and Technology, University of Science and Technology of China(中国科学技术大学网络科学与技术学院)

Yang Yang, Feifan Meng, Han Fang, Weiming Zhang

AI总结:

本文提出ACPO方法,通过锚点约束优化提升扩散模型的感知质量,同时保持生成多样性和训练稳定性。

摘要:

扩散模型在图像生成中取得显著成功,但其训练主要依赖全参考目标,强制像素与真实图像相似。此类监督在保真度上有效,但在主观视觉感知质量和文本-图像语义一致性方面可能不足。本文研究将无参考感知质量纳入扩散训练。关键挑战是直接优化感知信号,如无参考图像质量评估(NR-IQA)模型提供的信号,会引入与原始扩散目标的不匹配,导致训练不稳定和分布漂移。为此,我们提出一种锚点约束优化框架,实现稳定的感知适应。具体而言,我们利用学习的NR-IQA模型作为感知指导信号,并引入基于锚点的正则化,强制与基础扩散模型在噪声预测上保持一致。该设计有效平衡了感知质量提升和生成保真度,允许在不损害原始生成行为的情况下,向感知有利的输出进行受控适应。大量实验表明,我们的方法在提升感知质量的同时,保持了生成多样性和训练稳定性,突显了锚点约束感知优化在扩散模型中的有效性。

英文摘要:

Diffusion models have achieved remarkable success in image generation, yet their training is predominantly driven by full-reference objectives that enforce pixel-wise similarity to ground-truth images.Such supervision, while effective for fidelity, may insufficient in terms of subjective visual perception quality and text-image semantic consistency. In this work, we investigate the problem of incorporating no-reference perceptual quality into diffusion training. A key challenge is that directly optimizing perceptual signals, such as those provided by no-reference image quality assessment (NR-IQA) models, introduces a mismatch with the original diffusion objective, leading to training instability and distributional drift during fine-tuning. To address this issue, we propose an anchor-constrained optimization framework that enables stable perceptual adaptation. Specifically, we leverage a learned NR-IQA model as a perceptual guidance signal, while introducing an anchor-based regularization that enforces consistency with the base diffusion model in terms of noise prediction. This design effectively balances perceptual quality improvement and generative fidelity, allowing controlled adaptation toward perceptually favorable outputs without compromising the original generative behavior. Extensive experiments demonstrate that our method consistently enhances perceptual quality while preserving generation diversity and training stability, highlighting the effectiveness of anchor-constrained perceptual optimization for diffusion models.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑