Despite the growing interest in diffusion models, gaining a deep understanding of the model class remains an elusive endeavour, particularly for the uninitiated in non-equilibrium statistical physics. Thanks to the rapid rate of progress in the field, most existing work on diffusion models focuses on either applications or theoretical contributions. Unfortunately, the theoretical material is often inaccessible to practitioners and new researchers, leading to a risk of superficial understanding in ongoing research. Given that diffusion models are now an indispensable tool, a clear and consolidating perspective on the model class is needed to properly contextualize recent advances in generative modelling and lower the barrier to entry for new researchers. To that end, we revisit predecessors to diffusion models like hierarchical latent variable models and synthesize a holistic perspective using only directed graphical modelling and variational inference principles. The resulting narrative is easier to follow as it imposes fewer prerequisites on the average reader relative to the view from non-equilibrium thermodynamics or stochastic differential equations.
Demystifying Foreground-Background Memorization in Diffusion Models
Cheriton School of Computer Science, University of Waterloo and Vector Institute(查尔顿计算机科学学院,滑铁卢大学和向量研究所);University of Ottawa(渥太华大学);CISPA Helmholtz Center for Information Security(信息安全赫尔姆霍茨中心CISPA)
Demystifying Inductive Biases for $β$-VAE Based Architectures
Max Planck Institute for Intelligent Systems(马克斯·普朗克智能系统研究所)
$β$ -变分自动编码器($β$ -VAE)及其变体在学习语义上有意义的解纠缠表示方面的性能是无与伦比的。另一方面,有理论论据表明,无监督的解缠是不可能的。在这项工作中,我们揭示了负责基于VAE的架构的成功的感性偏见。我们表明,在经典的数据集的方差结构,诱导的生成因子,是方便地对齐的潜在方向培育的VAE目标。这就建立了VAE的解开能力所依赖的关键偏差。通过对现有数据集进行小而精细的扰动,我们隐藏了方便的相关结构,这种结构很容易被各种架构所利用。为了证明这一点,我们构建了标准数据集的修改版本,其中(i)生成因子被完美地保留;(ii)每个图像都经过温和的变换,导致方差的微小变化;(iii)领先的\textbf{VAE-based disentanglement architectures fail to produce disentangled representations whilst the performance of a non-variational method remains unchanged}。我们的修改的建设是不平凡的,并依赖于最近的进展机制的理解$β$ -VAE及其连接到PCA。我们通过提供具有独立利益的额外见解来加强这种联系。
SenseTime Research(商汤科技研究院);Nanyang Technological University(南洋理工大学);University of California, Berkeley(加州大学伯克利分校);University of California, San Diego(加州大学圣地亚哥分校);Carnegie Mellon University(卡内基梅隆大学)
Department of Computer and Information Sciences, University of Pennsylvania, Philadelphia, PA, U.S.A.(宾夕法尼亚大学计算机与信息科学系);Hal c o g lu Data Science Institute, University of California San Diego, San Diego, CA, U.S.A.(加州大学圣地亚哥分校Hal c o g lu数据科学研究所)
Diffusion-Weighted Magnetic Resonance Brain Images Generation with Generative Adversarial Networks and Variational Autoencoders: A Comparison Study
ETH Zurich(苏黎世联邦理工学院);University of Zurich(苏黎世大学);Stanford University(斯坦福大学);Stanford Stroke Center(斯坦福中风中心);Institute for Biomedical Engineering(生物医学工程研究所)
Variational Autoencoding Discrete Diffusion with Enhanced Dimensional Correlations Modeling
School of Mathematical Sciences, Peking University(北京大学数学科学学院);Center for Statistical Science, Peking University(北京大学统计科学中心);Academy of Mathematics and Systems Science, Chinese Academy of Sciences(中国科学院数学与系统科学研究院);Huawei Foundation Model Dept(华为基金会模型部门);The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳))
Hierarchical Semi-Implicit Variational Inference with Application to Diffusion Model Acceleration
Peking University(北京大学);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);Beijing Academy of Artificial Intelligence(北京人工智能研究院);Megvii Technology Inc.(旷视科技有限公司)
Discrete Diffusion Models via Evolving Variational Autoregressive Networks
Institute of Fundamental and Frontier Sciences, University of Electronic Science and Technology of China(电子科技大学基础与前沿研究院);School of Physics, University of Electronic Science and Technology of China(电子科技大学物理学院);Key Laboratory of Quantum Physics and Photonic Quantum Information, Ministry of Education, University of Electronic Science and Technology of China(电子科技大学教育部量子物理与光子量子信息重点实验室);Non-classical Information Science Basic Discipline Research Center of Sichuan Province, University of Electronic Science and Technology of China(电子科技大学四川省非经典信息科学基础学科研究中心)