arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2209.01170cs.CVcs.LG
收藏

生成流形、图和分类数据的首中扩散模型

First Hitting Diffusion Models for Generating Manifold, Graph and Categorical Data

The University of Texas at Austin(德克萨斯大学奥斯汀分校)

Mao Ye, Lemeng Wu, Qiang Liu

摘要:

我们提出了一个家庭的首次击中扩散模型(FHDM),深度生成模型,生成数据的扩散过程,终止于一个随机的首次击中时间。这产生了一个扩展的标准固定时间扩散模型,终止于一个预先指定的确定性的时间。虽然标准扩散模型是为连续无约束数据设计的,但FHDM自然被设计为学习连续以及一系列离散和结构域上的分布。此外,FHDM支持实例相关的终止时间,并加速扩散过程,以更少的扩散步骤采样更高质量的数据。从技术上讲,我们训练FHDM的最大似然估计的扩散轨迹扩大从观测数据与条件的第一击中过程(即,桥)基于Doob的$h$变换导出,偏离了常用的时间反转机制。我们应用FHDM来生成各个领域的数据,如点云(一般连续分布),地球上的气候和地理事件(球体上的连续分布),未加权图(二进制矩阵的分布)和2D图像的分割图(高维分类分布)。我们观察到相当大的改善相比,国家的最先进的方法在质量和速度。

英文摘要:

We propose a family of First Hitting Diffusion Models (FHDM), deep generative models that generate data with a diffusion process that terminates at a random first hitting time. This yields an extension of the standard fixed-time diffusion models that terminate at a pre-specified deterministic time. Although standard diffusion models are designed for continuous unconstrained data, FHDM is naturally designed to learn distributions on continuous as well as a range of discrete and structure domains. Moreover, FHDM enables instance-dependent terminate time and accelerates the diffusion process to sample higher quality data with fewer diffusion steps. Technically, we train FHDM by maximum likelihood estimation on diffusion trajectories augmented from observed data with conditional first hitting processes (i.e., bridge) derived based on Doob's $h$-transform, deviating from the commonly used time-reversal mechanism. We apply FHDM to generate data in various domains such as point cloud (general continuous distribution), climate and geographical events on earth (continuous distribution on the sphere), unweighted graphs (distribution of binary matrices), and segmentation maps of 2D images (high-dimensional categorical distribution). We observe considerable improvement compared with the state-of-the-art approaches in both quality and speed.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑