arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2603.09251stat.MLcs.LGcs.NAmath.NA
收藏

基于可逆性的生成采样器:用于可能具有离散参数分布的采样器

A Generative Sampler for distributions with possible discrete parameter based on Reversibility

School of Mathematical Sciences, Shanghai Jiao Tong University, Shanghai, 200240, P.R.China(上海交通大学数学科学学院);Institute of Natural Sciences, MOE-LSC, Shanghai Jiao Tong University, Shanghai, 200240, P.R.China(上海交通大学自然科学研究院)

Lei Li, Zhen Wang, Lishuo Zhang

AI总结:

本文提出了一种基于可逆性的生成采样器,适用于具有离散参数分布的复杂系统,通过最小化MMD来实现高效的采样方法。

摘要:

学习从复杂的非标准化分布中进行采样是计算物理和机器学习中的基本挑战。尽管基于分数和变分方法在连续域中取得了成功,但将其扩展到离散或混合变量系统仍然困难,因为梯度定义不清或估计器方差高。我们提出了一种统一的、目标梯度自由的生成采样框架,适用于多种状态空间。基于详细平衡意味着平衡随机过程的时间可逆性,我们将其作为统计约束来强制对称性。具体来说,使用预设的物理转移核(如Metropolis-Hastings),我们最小化正向和反向马尔可夫轨迹联合分布之间的最大均值差异(MMD)。关键的是,这种训练过程仅依赖于能量评估通过接受率,从而避免了需要目标分数函数或连续松弛的需要。我们证明了该方法在三个不同的基准测试中的通用性:(1)连续多模态高斯混合物,(2)高维Ising模型,(3)一个具有离散索引和连续动力学的挑战性混合系统。实验表明,我们的框架能够准确地再现热力学可观测变量,并在所有范围内捕捉到模式切换行为,提供了一种基于物理和普遍适用的平衡采样替代方案。

英文摘要:

Learning to sample from complex unnormalized distributions is a fundamental challenge in computational physics and machine learning. While score-based and variational methods have achieved success in continuous domains, extending them to discrete or mixed-variable systems remains difficult due to ill-defined gradients or high variance in estimators. We propose a unified, target-gradient-free generative sampling framework applicable across diverse state spaces. Building on the fact that detailed balance implies the time-reversibility of the equilibrium stochastic process, we enforce this symmetry as a statistical constraint. Specifically, using a prescribed physical transition kernel (such as Metropolis-Hastings), we minimize the Maximum Mean Discrepancy (MMD) between the joint distributions of forward and backward Markov trajectories. Crucially, this training procedure relies solely on energy evaluations via acceptance ratios, circumventing the need for target score functions or continuous relaxations. We demonstrate the versatility of our method on three distinct benchmarks: (1) a continuous multi-modal Gaussian mixture, (2) the discrete high-dimensional Ising model, and (3) a challenging hybrid system coupling discrete indices with continuous dynamics. Experiments show that our framework accurately reproduces thermodynamic observables and captures mode-switching behavior across all regimes, offering a physically grounded and universally applicable alternative for equilibrium sampling.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑