arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2603.20645cs.LG
收藏

流形数据的扩散模型:分数分解、曲率与统计复杂性

Diffusion Model for Manifold Data: Score Decomposition, Curvature, and Statistical Complexity

Georgia Tech(佐治亚理工学院);Princeton University(普林斯顿大学);Northwestern University(西北大学)

Zixuan Zhang, Kaixuan Huang, Tuo Zhao, Mengdi Wang, Minshuo Chen

AI总结:

本文研究扩散模型如何学习流形数据,通过分析分数函数的分解和曲率影响,提出高效的神经网络近似方法,并推导出基于数据内在维度和曲率的统计学习率。

摘要:

扩散模型已成为生成建模的主流框架,但其理论理解,特别是针对高维数据集中在低维结构上的情况仍不完善。本文研究扩散模型如何学习此类结构数据,重点探讨统计复杂性与数据几何性质的影响。通过将数据建模为光滑黎曼流形上的样本,我们的分析揭示了在不同噪声水平下扩散模型中分数函数的关键分解。我们还强调了流形曲率与分数函数结构之间的相互作用。这些分析使我们能够高效地近似分数函数,并进一步提供分数估计和分布学习的统计速率。值得注意的是,获得的统计速率由数据的内在维度和流形曲率决定。这些结果推进了扩散模型的统计基础,为流形上的生成建模建立了理论与实践之间的桥梁。

英文摘要:

Diffusion models have become a leading framework in generative modeling, yet their theoretical understanding -- especially for high-dimensional data concentrated on low-dimensional structures -- remains incomplete. This paper investigates how diffusion models learn such structured data, focusing on two key aspects: statistical complexity and influence of data geometric properties. By modeling data as samples from a smooth Riemannian manifold, our analysis reveals crucial decompositions of score functions in diffusion models under different levels of injected noise. We also highlight the interplay of manifold curvature with the structures in the score function. These analyses enable an efficient neural network approximation to the score function, built upon which we further provide statistical rates for score estimation and distribution learning. Remarkably, the obtained statistical rates are governed by the intrinsic dimension of data and the manifold curvature. These results advance the statistical foundations of diffusion models, bridging theory and practice for generative modeling on manifolds.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑