有限时间吉布斯训练在基于能量模型中的热力学调控:一项受限波尔兹曼机研究
Thermodynamic Regulation of Finite-Time Gibbs Training in Energy-Based Models: A Restricted Boltzmann Machine Study
AI总结:
本文提出了一种内生热力学调节框架,通过动态温度调控提升受限波尔兹曼机训练的稳定性与有效性。
摘要:
受限波尔兹曼机(RBMs)通常使用有限长度的吉布斯链在固定采样温度下进行训练。这种做法隐含假设在学习过程中能量景观演变时随机区域保持有效。我们主张在有限时间训练动态下,这一假设可能变得结构脆弱。这种脆弱性源于非凸基于能量模型中,固定温度有限时间训练会产生可接受的轨迹,具有有效场放大和导电崩溃。结果,吉布斯采样器可能渐近冻结,负相位局部化,且在足够强的正则化下,参数可能表现出确定性线性漂移。为了解决这种不稳定性,我们引入了一个内生热力学调节框架,在其中温度作为动态状态变量与可测量的采样统计量耦合。在标准局部利普希茨条件下和双时间尺度分离制度下,我们建立了严格正L2正则化下的全局参数有界性。我们进一步证明了热力学子系统的局部指数稳定性,并显示受控模式在正不变邻域内缓解了逆温度爆炸和冻结引起的退化。在MNIST上的实验表明,所提出的自调节RBM在正常化稳定性和有效样本大小方面相对于固定温度基线显著改进,同时保持重建性能。总体而言,结果将RBM训练重新解释为受控非平衡动态过程,而不是静态平衡近似。
英文摘要:
Restricted Boltzmann Machines (RBMs) are typically trained using finite-length Gibbs chains under a fixed sampling temperature. This practice implicitly assumes that the stochastic regime remains valid as the energy landscape evolves during learning. We argue that this assumption can become structurally fragile under finite-time training dynamics. This fragility arises because, in nonconvex energy-based models, fixed-temperature finite-time training can generate admissible trajectories with effective-field amplification and conductance collapse. As a result, the Gibbs sampler may asymptotically freeze, the negative phase may localize, and, without sufficiently strong regularization, parameters may exhibit deterministic linear drift. To address this instability, we introduce an endogenous thermodynamic regulation framework in which temperature evolves as a dynamical state variable coupled to measurable sampling statistics. Under standard local Lipschitz conditions and a two-time-scale separation regime, we establish global parameter boundedness under strictly positive L2 regularization. We further prove local exponential stability of the thermodynamic subsystem and show that the regulated regime mitigates inverse-temperature blow-up and freezing-induced degeneracy within a forward-invariant neighborhood. Experiments on MNIST demonstrate that the proposed self-regulated RBM substantially improves normalization stability and effective sample size relative to fixed-temperature baselines, while preserving reconstruction performance. Overall, the results reinterpret RBM training as a controlled non-equilibrium dynamical process rather than a static equilibrium approximation.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。