流形模型的扩散流
Spread Flows for Manifold Modelling
摘要:
基于流的模型通常定义一个潜在空间,其维度与观测空间相同。然而,在许多问题中,数据并没有填充它们本机驻留的完整环境数据空间,而是驻留在低维流形中。在这种情况下,基于流的模型无法精确地表示数据结构,因为它们的密度总是支持数据流形,可能导致模型性能下降。为了解决这个问题,我们建议学习流模型的流形先验,利用最近提出的扩散发散来解决关键问题;库尔贝克-莱布勒散度和极大似然估计对于流形学习是不明确的。除了提高样本质量和表示质量之外,我们的方法还能够识别流形分布的内在维度。
英文摘要:
Flow-based models typically define a latent space with dimensionality identical to the observational space. In many problems, however, the data does not populate the full ambient data space that they natively reside in, rather inhabiting a lower-dimensional manifold. In such scenarios, flow-based models are unable to represent data structures exactly as their densities will always have support off the data manifold, potentially resulting in degradation of model performance. To address this issue, we propose to learn a manifold prior for flow models that leverage the recently proposed spread divergence towards fixing the crucial problem; the KL divergence and maximum likelihood estimation are ill-defined for manifold learning. In addition to improving both sample quality and representation quality, an auxiliary benefit enabled by our approach is the ability to identify the intrinsic dimension of the manifold distribution.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。