Foundations of Diffusion Models in General State Spaces: A Self-Contained Introduction
Technical University of Munich(慕尼黑工业大学);Helmholtz AI(亥姆霍兹AI);Munich Center for Machine Learning (MCML)(慕尼黑机器学习中心);Mila – Quebec AI Institute(Mila-魁北克人工智能研究所);AITHYRA
Vincent Pauline, Tobias Höppe, Kirill Neklyudov, Alexander Tong, Stefan Bauer, Andrea Dittadi
Although diffusion models now occupy a central place in generative modeling, introductory treatments commonly assume Euclidean data and seldom clarify their connection to discrete-state analogues. This article is a self-contained primer on diffusion over general state spaces, unifying continuous domains and discrete/categorical structures under one lens. We develop the discrete-time view (forward noising via Markov kernels and learned reverse dynamics) alongside its continuous-time limits -- stochastic differential equations (SDEs) in $\mathbb{R}^d$ and continuous-time Markov chains (CTMCs) on finite alphabets -- and derive the associated Fokker--Planck and master equations. A common variational treatment yields the ELBO that underpins standard training losses. We make explicit how forward corruption choices -- Gaussian processes in continuous spaces and structured categorical transition kernels (uniform, masking/absorbing and more) in discrete spaces -- shape reverse dynamics and the ELBO. The presentation is layered for three audiences: newcomers seeking a self-contained intuitive introduction; diffusion practitioners wanting a global theoretical synthesis; and continuous-diffusion experts looking for an analogy-first path into discrete diffusion. The result is a unified roadmap to modern diffusion methodology across continuous domains and discrete sequences, highlighting a compact set of reusable proofs, identities, and core theoretical principles.
CTSyn: A Foundation Model for Cross Tabular Data Generation
Department of Statistics and Data Science, University of California Los Angeles(统计与数据科学系,加州大学洛杉矶分校);Department of Computer Science, University of California Los Angeles(计算机科学系,加州大学洛杉矶分校)
Elign: Equivariant Diffusion Model Alignment from Foundational Machine Learning Force Fields
Department of Computer Science, Yale University, New Haven, USA(计算机科学系,耶鲁大学,新 Haven,USA);Program in Computational Biology and Biomedical Informatics, Yale University, New Haven, USA(计算生物学与生物医学信息学项目,耶鲁大学,新 Haven,USA);IQuestLab
VFM-VAE: Vision Foundation Models Can Be Good Tokenizers for Latent Diffusion Models
State Key Laboratory of Human-Machine Hybrid Augmented Intelligence, Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University(人机混合增强智能国家重点实验室,人工智能与机器人研究院,西安交通大学);Microsoft Research Asia(微软亚洲研究院)
Generative AI Meets 6G and Beyond: Diffusion Models for Semantic Communications
Beijing University of Posts and Telecommunications(北京邮电大学);Shanghai Jiao Tong University(上海交通大学);East China Normal University(华东师范大学);Tsinghua University(清华大学);Hong Kong University of Science and Technology(香港科技大学)