We present a concise derivation for several influential score-based diffusion models that relies on only a few textbook results. Diffusion models have recently emerged as powerful tools for generating realistic, synthetic signals -- particularly natural images -- and often play a role in state-of-the-art algorithms for inverse problems in image processing. While these algorithms are often surprisingly simple, the theory behind them is not, and multiple complex theoretical justifications exist in the literature. Here, we provide a simple and largely self-contained theoretical justification for score-based diffusion models that is targeted towards the signal processing community. This approach leads to generic algorithmic templates for training and generating samples with diffusion models. We show that several influential diffusion models correspond to particular choices within these templates and demonstrate that alternative, more straightforward algorithmic choices can provide comparable results. This approach has the added benefit of enabling conditional sampling without any likelihood approximation.
Tweedie's Formulae and Diffusion Generative Models Beyond Gaussian
Department of Industrial Engineering and Operations Research, Columbia University(哥伦比亚大学工业工程与运筹学系);Department of Finance and Risk Engineering, New York University(纽约大学金融与风险工程系)
Binomial flows: Denoising and flow matching for discrete ordinal data
Division of Applied Mathematics, Brown University, Providence, RI, USA 02912(应用数学系,布朗大学,普罗维德恩,罗德岛州,美国 02912);Department of Statistical Sciences, University of Toronto, Toronto, ON, Canada M5G 1X6(统计科学系,多伦多大学,多伦多,安大略省,加拿大 M5G 1X6)
Walkable to Whom? Capturing Subjective Variability in Walkability Perception Using Multimodal Deep Learning
School of Civil and Environmental Engineering, University of New South Wales (UNSW)(新南威尔士大学土木与环境工程学院);Research Centre for Integrated Transport Innovation (rCITI)(综合交通创新研究中心)
Segmentation of Lumen and External Elastic Laminae in Intravascular Ultrasound Images using Ultrasonic Backscattering Physics Initialized Multiscale Random Walks
Advanced Technology Development Centre(先进技术发展中心);Department of Computer Science and Engineering(计算机科学与工程系);Department of Electrical Engineering(电气工程系);Indian Institute of Technology Kharagpur(印度理工学院卡哈拉格普尔分校);India(印度(注:根据上下文,此处“India”为国家,非机构,原数据可能存在格式问题,按要求不提取国家信息,但按输出要求保留英文机构名))