arXivDaily arXiv每日学术速递 周一至周五更新
arXiv cs/0501091cs.ITmath.IT
收藏

一种复杂度正则化的非线性降维方法quantization

A complexity-regularized quantization approach to nonlinear dimensionality reduction

Maxim Raginsky

摘要:

我们考虑非线性降维问题:给定一组高维数据的训练集,假设其“固有”低维是已知的,找到一个低维空间的特征提取映射,一个返回高维空间的重建映射,以及降维数据作为光滑流形的几何描述。我们引入了一个复杂性正则化的量化方法,通过劳埃德算法拟合高斯混合模型的训练集。复杂性正则化控制了底层流形的局部形状适应性和全局几何一致性之间的权衡。得到的混合模型用于设计特征提取和重建图,并定义一个黎曼度量的低维数据。我们还勾画了一个证明我们的计划的一致性的目的,估计未知的潜在的PDF的高维数据。

英文摘要:

We consider the problem of nonlinear dimensionality reduction: given a training set of high-dimensional data whose ``intrinsic'' low dimension is assumed known, find a feature extraction map to low-dimensional space, a reconstruction map back to high-dimensional space, and a geometric description of the dimension-reduced data as a smooth manifold. We introduce a complexity-regularized quantization approach for fitting a Gaussian mixture model to the training set via a Lloyd algorithm. Complexity regularization controls the trade-off between adaptation to the local shape of the underlying manifold and global geometric consistency. The resulting mixture model is used to design the feature extraction and reconstruction maps and to define a Riemannian metric on the low-dimensional data. We also sketch a proof of consistency of our scheme for the purposes of estimating the unknown underlying pdf of high-dimensional data.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑