arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2407.21435stat.MLcs.LG
收藏

流形上概率学习的瞬态各向异性核

Transient anisotropic kernel for probabilistic learning on manifolds

Université Gustave Eiffel(古斯塔夫·埃菲尔大学);University of Southern California(南加州大学)

Christian Soize, Roger Ghanem

AI总结:

本文提出用瞬态各向异性核构建新的ISDE投影向量基替代DMAPS基,以改进异质数据下流形概率学习PLoM的统计代理模型,并通过互信息与熵估计确定最优时刻,实验验证其能更好地表示统计依赖关系。

摘要:

PLoM(流形上的概率学习)是2016年提出的一种方法,用于处理小训练数据集,其方式是将一个来自随机耗散哈密顿动力学系统的Itô方程投影出来,该系统充当MCMC生成器,对于该系统而言,以训练数据集进行KDE估计得到的概率测度是不变测度。PLoM在与训练数据集相关的降阶向量基上进行投影,使用的是由时间无关的各向同性核构建的扩散映射(DMAPS)基。在本文中,我们提出了一种新的ISDE投影向量基,该基由一个瞬态各向异性核构建而成,为具有异质数据的随机流形提供了一种替代DMAPS基的方案,以改进统计代理模型。该构造确保在接近初始时刻的时间上,DMAPS基与瞬态基重合。对于更大的时间,两个基之间的差异由它们所张成向量子空间之间的夹角来刻画。产生最优瞬态基的最优时刻通过信息论中互信息的估计来确定,该互信息通过熵估计进行归一化,以考虑估计中使用的实现数量所带来的影响。因此,这一新的向量基在任何维度上都能更好地表示所学概率测度中的统计依赖关系。三个具有不同统计复杂度和数据异质性水平的应用验证了所提出的理论,表明瞬态各向异性核改进了所学到的概率测度。

英文摘要:

PLoM (Probabilistic Learning on Manifolds) is a method introduced in 2016 for handling small training datasets by projecting an Itô equation from a stochastic dissipative Hamiltonian dynamical system, acting as the MCMC generator, for which the KDE-estimated probability measure with the training dataset is the invariant measure. PLoM performs a projection on a reduced-order vector basis related to the training dataset, using the diffusion maps (DMAPS) basis constructed with a time-independent isotropic kernel. In this paper, we propose a new ISDE projection vector basis built from a transient anisotropic kernel, providing an alternative to the DMAPS basis to improve statistical surrogates for stochastic manifolds with heterogeneous data. The construction ensures that for times near the initial time, the DMAPS basis coincides with the transient basis. For larger times, the differences between the two bases are characterized by the angle of their spanned vector subspaces. The optimal instant yielding the optimal transient basis is determined using an estimation of mutual information from Information Theory, which is normalized by the entropy estimation to account for the effects of the number of realizations used in the estimations. Consequently, this new vector basis better represents statistical dependencies in the learned probability measure for any dimension. Three applications with varying levels of statistical complexity and data heterogeneity validate the proposed theory, showing that the transient anisotropic kernel improves the learned probability measure.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑