发表机构
The University of Sydney(悉尼大学)
机构由 AI 辅助整理,请以论文原文为准。AI 中文总结
本研究提出质量门控去白化(QGD)控制器,通过控制极性暴露延迟扩散模型记忆化,结合复制预算选择(CBS),在CIFAR-10上将有用间隔扩展8.32倍并减少75.9%复制,改善质量-复制权衡。
AI 中文摘要
扩散模型在复制训练样本之前可以达到有用的样本质量,但快速优化会通过加速样本特定拟合来压缩这一泛化窗口。我们通过更新几何研究这一效应,并提出质量门控去白化(QGD),这是一种保留快速极性更新前缀并逐步恢复固定增益动量的控制器。我们的随机特征分析分离了协方差控制、曲率均衡和幅度控制的记忆化时钟。在对齐谱假设下,它建立了有限暴露条件,在该条件下,固定增益尾部恢复与数据集大小成比例的延迟。QGD通过确认的质量门、有界衰减包络和因果复制反馈实现这一原理。立即切换是保守极限;渐进控制平衡延迟复制与持续质量改进。我们将QGD与复制预算选择(CBS)配对,CBS对冻结检查点系列应用同步二项校准,然后对发布的检查点进行全新评估。在2,000张图像的CIFAR-10子集上,QGD保持了极性基线的质量到达时间,同时将其有用间隔扩展了8.32倍,并将公共检查点复制减少了75.9%。在相同校准和独立质量评估下,QGD达到FID 75.56,而使用相同选择器的SGD为79.37。暴露匹配控制、独立检测器审计以及向流匹配和舞蹈生成的迁移支持自适应暴露控制作为改善质量-复制权衡的实用方法。
英文摘要
Diffusion models can reach useful sample quality before copying training examples, but fast optimization can compress this generalization window by accelerating sample-specific fitting. We investigate this effect through update geometry and propose Quality-Gated De-whitening (QGD), a controller that retains a fast polar-update prefix and progressively restores fixed-gain momentum. Our random-feature analysis separates covariance-controlled, curvature-equalized and amplitude-controlled memorization clocks. Under aligned spectral assumptions, it establishes a finite-exposure condition under which a fixed-gain tail recovers a delay proportional to dataset size. QGD implements this principle with a confirmed quality gate, a bounded decay envelope and causal copy feedback. Immediate switching is the conservative limit; gradual control balances delayed copying against continued quality improvement. We pair QGD with Copy-Budgeted Selection (CBS), which applies simultaneous binomial calibration to a frozen checkpoint family, followed by a fresh evaluation of the released checkpoint. On 2,000-image CIFAR-10 subsets, QGD preserves the polar baseline's quality-arrival time while expanding its useful interval by 8.32x and reducing common-checkpoint copying by 75.9%. With identical calibration and independent quality evaluation, QGD achieves FID 75.56 versus 79.37 for SGD with the same selector. Exposure-matched controls, independent detector audits and transfer to flow matching and dance generation support adaptive exposure control as a practical way to improve the quality-copying tradeoff.
Comments31 pages, 4 figures