Efficient Training of Boltzmann Generators Using Off-Policy Log-Dispersion Regularization
Institute of Nanotechnology, Karlsruhe Institute of Technology, Kaiserstr. 12, 76131 Karlsruhe, Germany(纳米技术研究所,卡尔斯鲁厄理工大学,Kaiserstr. 12,76131 卡尔斯鲁厄,德国);Institute for Anthropomatics and Robotics, Karlsruhe Institute of Technology, Kaiserstr. 12, 76131 Karlsruhe, Germany(人机学与机器人研究所,卡尔斯鲁厄理工大学,Kaiserstr. 12,76131 卡尔斯鲁厄,德国)
Henrik Schopmans, Christopher von Klitzing, Pascal Friederich
Sampling from unnormalized probability densities is a central challenge in computational science. Boltzmann generators are generative models that enable independent sampling from the Boltzmann distribution of physical systems at a given temperature. However, their practical success depends on data-efficient training, as both simulation data and target energy evaluations are costly. To this end, we propose off-policy log-dispersion regularization (LDR), a novel regularization framework that builds on a generalization of the log-variance objective. We apply LDR in the off-policy setting in combination with standard data-based training objectives, without requiring additional on-policy samples. LDR acts as a shape regularizer of the energy landscape by leveraging additional information in the form of target energy labels. The proposed regularization framework is broadly applicable, supporting unbiased or biased simulation datasets as well as purely variational training without access to target samples. Across all benchmarks, LDR improves both final performance and data efficiency, with sample efficiency gains of up to one order of magnitude.
Learning Boltzmann Generators via Constrained Mass Transport
Autonomous Learning Robots, Karlsruhe Institute of Technology(自动化学习机器人,卡尔斯鲁厄大学技术学院);Artificial Intelligence for Materials Sciences, Karlsruhe Institute of Technology(材料科学人工智能,卡尔斯鲁厄大学技术学院)
Institute of Nanotechnology, Karlsruhe Institute of Technology(卡尔斯鲁厄理工学院纳米技术研究所);Institute of Theoretical Informatics, Karlsruhe Institute of Technology(卡尔斯鲁厄理工学院理论计算机科学研究所)
Quantum-inspired annealers as Boltzmann generators for machine learning and statistical physics
Russian Quantum Center(俄罗斯量子中心);Moscow Institute of Physics and Technology(莫斯科物理技术学院);University of Oxford(牛津大学);P. N. Lebedev Physics Institute(P. N. 列别杰夫物理研究所)
Transition Path Sampling with Boltzmann Generator-based MCMC Moves
School of Computation, Information and Technology, TUM(慕尼黑工业大学计算、信息与技术学院);Computer Science and Artificial Intelligence Laboratory, MIT(麻省理工学院计算机科学与人工智能实验室);Department of Computer Science, ETH Zürich(苏黎世联邦理工学院计算机科学系)
Scalable Boltzmann Generators for equilibrium sampling of large-scale materials
Microsoft Research AI for Science(微软研究院人工智能科学部门);Department of Chemistry, Rice University(理查德·伊尔大学化学系);Initiative for Computational Catalysis, Flatiron Institute(计算催化倡议,Flatiron研究所)
Energy based diffusion generator for efficient sampling of Boltzmann distributions
School of Mathematical Sciences, Tongji University(同济大学数学科学学院);Department of Mathematics, Shanghai Normal University(上海师范大学数学系);Institute of Computational Mathematics and Scientific/Engineering Computing, AMSS, Chinese Academy of Sciences(中国科学院数学与系统科学研究院)
Boltzmann generators for amorphous particle systems
Laboratoire de Physique de l’École normale supérieure ENS, Université PSL, CNRS, Sorbonne Université, Université de Paris(巴黎高等师范学院物理实验室,巴黎科学研究院,法国国家科学研究中心,索邦大学,巴黎大学);CMAP, CNRS, École polytechnique, Institut Polytechnique de Paris(巴黎高等理工学院计算数学与应用物理实验室,法国国家科学研究中心,巴黎理工学院,巴黎理工研究院);Dipartimento di Fisica, Università di Trieste(特伦蒂诺-上阿迪杰大学物理系);Gulliver, CNRS UMR 7083, ESPCI Paris, PSL Research University(Gulliver,法国国家科学研究中心UMR 7083,巴黎高等师范学院,巴黎科学研究院)
Professorship of Multiscale Modeling of Fluid Materials, Department of Engineering Physics and Computation, TUM School of Engineering and Design, Technical University of Munich, Germany(多尺度流体材料建模教授职位,工程物理与计算系,TUM工程与设计学院,慕尼黑技术大学,德国);Atomistic Modeling Center, Munich Data Science Institute, Technical University of Munich, Germany(原子建模中心,慕尼黑数据科学研究所,慕尼黑技术大学,德国)
University of Toronto(多伦多大学);NVIDIA(英伟达);Vector Institute(向量研究所);ETH Zurich(苏黎世联邦理工学院);NCCR Catalysis(瑞士国家研究能力中心催化分部);Acceleration Consortium(加速联盟);CIFAR(加拿大高等研究院)
Efficient Regression-Based Training of Normalizing Flows for Boltzmann Generators
Mila – Québec AI Institute(魁北克AI研究所);Université de Montréal(蒙特利尔大学);Massachusetts Institute of Technology(麻省理工学院);University of Oxford(牛津大学);AITHYRA;HEC Montréal(蒙特利尔HEC)
GM Score: Incorporating inter-class and intra-class generator diversity, discriminability of disentangled representation, and sample fidelity for evaluating GANs
School of Computer Engineering, KIIT Deemed to be University(KIIT 大学计算机工程学院)
Pairing Regularization for Mitigating Many-to-One Collapse in GANs
Institute of Communications Engineering, National Yang Ming Chiao Tung University;Department of Electrical \& Computer Engineering, Texas A\&M University
BoltzNCE: Learning Likelihoods for Boltzmann Generation with Stochastic Interpolants and Noise Contrastive Estimation
CMU-Pitt Computational Biology Dept. of Computational & Systems Biology University of Pittsburgh(卡内基梅隆大学-匹兹堡计算生物学系,计算与系统生物学系,匹兹堡大学);Machine Learning Dept. Dept. of Mathematical Sciences Carnegie Mellon University(机器学习系,数学科学系,卡内基梅隆大学);Dept. of Computational & Systems Biology University of Pittsburgh(计算与系统生物学系,匹兹堡大学)