Diffusion-based generative models have demonstrated a capacity for perceptually impressive synthesis, but can they also be great likelihood-based models? We answer this in the affirmative, and introduce a family of diffusion-based generative models that obtain state-of-the-art likelihoods on standard image density estimation benchmarks. Unlike other diffusion-based models, our method allows for efficient optimization of the noise schedule jointly with the rest of the model. We show that the variational lower bound (VLB) simplifies to a remarkably short expression in terms of the signal-to-noise ratio of the diffused data, thereby improving our theoretical understanding of this model class. Using this insight, we prove an equivalence between several models proposed in the literature. In addition, we show that the continuous-time VLB is invariant to the noise schedule, except for the signal-to-noise ratio at its endpoints. This enables us to learn a noise schedule that minimizes the variance of the resulting VLB estimator, leading to faster optimization. Combining these advances with architectural improvements, we obtain state-of-the-art likelihoods on image density estimation benchmarks, outperforming autoregressive models that have dominated these benchmarks for many years, with often significantly faster optimization. In addition, we show how to use the model as part of a bits-back compression scheme, and demonstrate lossless compression rates close to the theoretical optimum. Code is available at https://github.com/google-research/vdm .
Variational Autoencoding Discrete Diffusion with Enhanced Dimensional Correlations Modeling
School of Mathematical Sciences, Peking University(北京大学数学科学学院);Center for Statistical Science, Peking University(北京大学统计科学中心);Academy of Mathematics and Systems Science, Chinese Academy of Sciences(中国科学院数学与系统科学研究院);Huawei Foundation Model Dept(华为基金会模型部门);The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳))
Discrete Diffusion Models via Evolving Variational Autoregressive Networks
Institute of Fundamental and Frontier Sciences, University of Electronic Science and Technology of China(电子科技大学基础与前沿研究院);School of Physics, University of Electronic Science and Technology of China(电子科技大学物理学院);Key Laboratory of Quantum Physics and Photonic Quantum Information, Ministry of Education, University of Electronic Science and Technology of China(电子科技大学教育部量子物理与光子量子信息重点实验室);Non-classical Information Science Basic Discipline Research Center of Sichuan Province, University of Electronic Science and Technology of China(电子科技大学四川省非经典信息科学基础学科研究中心)
Diffusion-Weighted Magnetic Resonance Brain Images Generation with Generative Adversarial Networks and Variational Autoencoders: A Comparison Study
ETH Zurich(苏黎世联邦理工学院);University of Zurich(苏黎世大学);Stanford University(斯坦福大学);Stanford Stroke Center(斯坦福中风中心);Institute for Biomedical Engineering(生物医学工程研究所)
Hierarchical Semi-Implicit Variational Inference with Application to Diffusion Model Acceleration
Peking University(北京大学);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);Beijing Academy of Artificial Intelligence(北京人工智能研究院);Megvii Technology Inc.(旷视科技有限公司)
Inference-Time Alignment for Diffusion Models via Variationally Stable Doob's Matching
Joint Laboratory of Data Science and Business Intelligence(数据科学与商业智能联合实验室);State Key Laboratory of Mathematical Sciences(数学科学国家重点实验室);Institut für Geometrie und Praktische Mathematik(几何与应用数学研究所);School of Artificial Intelligence(人工智能学院);School of Mathematics and Statistics(数学与统计学院)
Variational inference for pile-up removal at hadron colliders with diffusion models
Département de physique nucléaire et corpusculaire, University of Geneva, Geneva 1211 Switzerland(核物理与粒子物理系,日内瓦大学,瑞士日内瓦1211);Department of physics, University of Warwick, Coventry CV4 7AL, United Kingdom(物理系,沃里克大学,英国科文特里CV4 7AL)
Fast and Robust Likelihood-Guided Diffusion Posterior Sampling with Amortized Variational Inference
Institute of Foundation Models, MBZUAI(基础模型研究所,MBZUAI);Huawei Lagrange Mathematics and Computing Research Center, Paris, France(华为拉格朗日数学与计算研究中心,法国巴黎);Mohamed Bin Zayed University of AI, Chair of the ML Department, EPITA, Laboratoire Recherche de l'EPITA(穆罕默德·本·扎耶德人工智能大学,机器学习系主任,EPITA,EPITA研究实验室)
Variational Optimality of Föllmer Processes in Generative Diffusions
Department of Mathematics, University of California, Los Angeles, CA, USA(加州大学洛杉矶分校数学系);Machine Learning Lab, Capital Fund Management, Paris, France(Capital Fund Management机器学习实验室);Courant Institute, New York University, NY, USA(纽约大学Courant研究所)
Moment Estimate and Variational Approach for Learning Generalized Diffusion with Non-gradient Structures
Department of Applied Mathematics, University of Washington(华盛顿大学应用数学系);Department of Applied Mathematics, Illinois Institute of Technology(伊利诺伊理工学院应用数学系)