arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2402.06121cs.LGstat.ML
收藏

迭代去噪能量匹配用于从玻尔兹曼密度中采样

Iterated Denoising Energy Matching for Sampling from Boltzmann Densities

Mila – Québec AI Institute(米拉-魁北克人工智能研究所);McGill University(麦吉尔大学);Dreamfold;Université de Montréal(蒙特利尔大学);University of Oxford(牛津大学);Ciela Institute(Ciela研究所);Center for Computational Astrophysics, Flatiron Institute(弗拉铁隆研究所计算天体物理中心);Jagiellonian University(雅盖隆大学);CIFAR(加拿大高级研究所)
Tara Akhound-Sadegh, Jarrid Rector-Brooks, Avishek Joey Bose, Sarthak Mittal, Pablo Lemos, Cheng-Hao Liu, Marcin Sendera, Siamak Ravanbakhsh, Gauthier Gidel, Yo… 展开作者

Tara Akhound-Sadegh, Jarrid Rector-Brooks, Avishek Joey Bose, Sarthak Mittal, Pablo Lemos, Cheng-Hao Liu, Marcin Sendera, Siamak Ravanbakhsh, Gauthier Gidel, Yoshua Bengio, Nikolay Malkin, Alexander Tong

AI总结:

提出迭代去噪能量匹配(iDEM),利用能量函数及其梯度训练扩散采样器,无需数据样本,实现高效采样,性能最优且训练快2-5倍,首次用于55粒子Lennard-Jones系统。

摘要:

从未归一化的概率分布中高效生成统计上独立的样本,例如多体系统的平衡样本,是科学中的一个基础问题。在本文中,我们提出了迭代去噪能量匹配(iDEM),一种迭代算法,该算法利用一种新颖的随机分数匹配目标,仅依靠能量函数及其梯度——无需数据样本——来训练基于扩散的采样器。具体来说,iDEM交替进行(I)从基于扩散的采样器中采样高模型密度区域,以及(II)使用这些样本在我们的随机匹配目标中进一步改进采样器。iDEM可扩展到高维,因为内部匹配目标是免模拟的,并且不需要MCMC样本。此外,通过利用扩散的快速模式混合行为,iDEM平滑了能量景观,从而实现高效的探索和学习摊销采样器。我们在从标准合成能量函数到不变的$n$体粒子系统的一系列任务上评估iDEM。我们表明,所提出的方法在所有指标上达到了最先进的性能,并且训练速度快$2-5$倍,这使其成为第一个使用能量在具有挑战性的$55$粒子Lennard-Jones系统上训练的方法。

英文摘要:

Efficiently generating statistically independent samples from an unnormalized probability distribution, such as equilibrium samples of many-body systems, is a foundational problem in science. In this paper, we propose Iterated Denoising Energy Matching (iDEM), an iterative algorithm that uses a novel stochastic score matching objective leveraging solely the energy function and its gradient -- and no data samples -- to train a diffusion-based sampler. Specifically, iDEM alternates between (I) sampling regions of high model density from a diffusion-based sampler and (II) using these samples in our stochastic matching objective to further improve the sampler. iDEM is scalable to high dimensions as the inner matching objective, is simulation-free, and requires no MCMC samples. Moreover, by leveraging the fast mode mixing behavior of diffusion, iDEM smooths out the energy landscape enabling efficient exploration and learning of an amortized sampler. We evaluate iDEM on a suite of tasks ranging from standard synthetic energy functions to invariant $n$-body particle systems. We show that the proposed approach achieves state-of-the-art performance on all metrics and trains $2-5\times$ faster, which allows it to be the first method to train using energy on the challenging $55$-particle Lennard-Jones system.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑