arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2604.00481stat.MEstat.ML
收藏

Tucker扩散模型用于高维张量生成

Tucker Diffusion Model for High-dimensional Tensor Generation

Jianhua Guo, Xinbing Kong, Zeyu Li, Junfan Mao

AI总结:

本文提出Tucker扩散模型,通过低秩Tucker假设实现张量分布的学习,利用Tucker-Unet架构在高维张量生成中取得理论和实践优势。

摘要:

对高维张量数据的统计推断在文献中已被广泛研究,并广泛应用于经济学、生物学、机器学习等领域,但如何生成具有目标分布的结构化张量仍是一个新问题。作为深刻的AI生成器,扩散模型在学习复杂分布方面取得了显著成功。然而,将其扩展到生成多线性张量值观测仍处于探索阶段。本文提出了一种新颖的Tucker扩散模型用于学习高维张量分布。我们证明,在低秩Tucker假设下,分数函数允许结构分解,从而可以使用精心设计的张量形状架构Tucker-Unet进行准确近似和高效估计。此外,由估计分数函数诱导的生成张量分布以最大张量模式维度的速率收敛到真实数据分布,从而在理论上有明显优势于朴素的向量化方法,后者具有乘积依赖性。实验表明,与现有方法相比,Tucker扩散模型在合成和实际张量生成任务中展现出强大的实用潜力,实现了可比甚至有时更优的统计性能,同时显著降低了训练和采样成本。

英文摘要:

Statistical inference on large-dimensional tensor data has been extensively studied in the literature and widely used in economics, biology, machine learning, and other fields, but how to generate a structured tensor with a target distribution is still a new problem. As profound AI generators, diffusion models have achieved remarkable success in learning complex distributions. However, their extension to generating multi-linear tensor-valued observations remains underexplored. In this work, we propose a novel Tucker diffusion model for learning high-dimensional tensor distributions. We show that the score function admits a structured decomposition under the low Tucker rank assumption, allowing it to be both accurately approximated and efficiently estimated using a carefully tailored tensor-shaped architecture named Tucker-Unet. Furthermore, the distribution of generated tensors, induced by the estimated score function, converges to the true data distribution at a rate depending on the maximum of tensor mode dimensions, thereby offering a clear theoretical advantage over the naive vectorized approach, which has a product dependence. Empirically, compared to existing approaches, the Tucker diffusion model demonstrates strong practical potential in synthetic and real-world tensor generation tasks, achieving comparable and sometimes even superior statistical performance with significantly reduced training and sampling costs.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑