对称破缺与非局域性相变在扩散模型中的共存
Concurrence of Symmetry Breaking and Nonlocality Phase Transitions in Diffusion Models
AI总结:
研究现代扩散变换器中对称破缺与非局域性相变是否共存,通过分析生成轨迹动态和结果,发现两者近似同时发生,首次统一两种相变概念,为评估模型效率和指导架构设计提供依据。
摘要:
扩散模型在生成动态中经历相变,有两个互补的临界性诊断。对称破缺观点认为临界窗口是轨迹分裂为不同语义能量景观最小值的时刻,而非局域性观点认为临界窗口是局部去噪失效的时刻。我们研究现代扩散变换器中两种相变概念是否共存。通过评估生成轨迹的动态和结果,我们观察到非局域性和对称破缺临界时间几乎同时发生。我们的工作首次在实践中统一两种相变概念:它提供了具体的诊断方法,说明扩散模型何时以及为何依赖于条件和全局去噪,从而为模型效率的原理性评估提供依据,并指导架构和采样方案的设计,以避免不必要的计算。
英文摘要:
Diffusion models undergo a phase transition in a critical time window during generation dynamics, with two complementary diagnoses of criticality. The symmetry breaking picture views the critical window as when trajectories bifurcate into different semantic minima of the energy landscape, whereas the nonlocality picture views the critical window as when local denoising fails. We study whether two notions of such phase transitions are concurrent in modern diffusion transformers. By evaluating the dynamics and outcomes of the generation trajectory, we observe a near-simultaneous occurrence of the non-locality and symmetry breaking critical times. Our work is the first to unify the two notions of phase transitions in practice: it provides a concrete diagnostic for when and why diffusion models rely on conditioning and global denoising, enabling principled evaluation of model efficiency and guiding the design of architectures and sampling schemes that avoid unnecessary computation.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。