谱离散性降低的统一概率观点:见解和新模型
A Unifying Probabilistic Perspective for Spectral Dimensionality Reduction: Insights and New Models
摘要:
我们引入了一个新的视角,认为这些方法的谱降维高斯马尔可夫随机场(GRF)。我们统一的观点是基于最大熵原理,这反过来又受到最大方差展开的启发。由此产生的模型,我们称之为最大熵展开(MEU)是主成分分析的非线性推广。我们将该模型与Laplacian特征映射和isomap联系起来。我们证明了局部线性嵌入(LLE)中的参数拟合是近似最大似然MEU。我们引入了一个变种的LLE,执行最大似然正是:无环LLE(ALLE)。我们表明,MEU和ALLE的竞争力与领先的光谱方法的机器人导航可视化和人类运动捕捉数据集。最后,最大似然的角度来看,允许我们引入一个新的方法,通过图形套索的高斯随机场的L1正则化的基础上降维。
英文摘要:
We introduce a new perspective on spectral dimensionality reduction which views these methods as Gaussian Markov random fields (GRFs). Our unifying perspective is based on the maximum entropy principle which is in turn inspired by maximum variance unfolding. The resulting model, which we call maximum entropy unfolding (MEU) is a nonlinear generalization of principal component analysis. We relate the model to Laplacian eigenmaps and isomap. We show that parameter fitting in the locally linear embedding (LLE) is approximate maximum likelihood MEU. We introduce a variant of LLE that performs maximum likelihood exactly: Acyclic LLE (ALLE). We show that MEU and ALLE are competitive with the leading spectral approaches on a robot navigation visualization and a human motion capture data set. Finally the maximum likelihood perspective allows us to introduce a new approach to dimensionality reduction based on L1 regularization of the Gaussian random field via the graphical lasso.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。