可逆流形学习降维算法
Invertible Manifold Learning for Dimension Reduction
摘要:
降维(DR)的目的是学习高维数据的低维表示,保留基本信息。在流形学习的背景下,我们定义了信息无损DR后的表示形式上保持了数据流形的拓扑和几何性质,并提出了一种新的两阶段DR方法,称为可逆流形学习(inv-ML),以弥合理论信息无损和实际DR之间的差距。第一阶段包括同胚稀疏坐标变换,以学习低分辨率,三维表示,而不破坏拓扑和局部等距约束,以保持局部几何。在第二阶段中,线性压缩被实现用于在目标维度和在过度DR场景中引起的信息丢失之间的权衡。在七个数据集上进行了实验,并使用神经网络实现了inv-ML,称为i-ML-Enc。经验上,i-ML-Enc与典型的现有方法相比实现了可逆DR,并揭示了学习流形的特征。通过对真实数据集的隐空间插值,我们发现局部邻域逼近切空间的可靠性是基于流形的DR算法成功的关键。
英文摘要:
Dimension reduction (DR) aims to learn low-dimensional representations of high-dimensional data with the preservation of essential information. In the context of manifold learning, we define that the representation after information-lossless DR preserves the topological and geometric properties of data manifolds formally, and propose a novel two-stage DR method, called invertible manifold learning (inv-ML) to bridge the gap between theoretical information-lossless and practical DR. The first stage includes a homeomorphic sparse coordinate transformation to learn low-dimensional representations without destroying topology and a local isometry constraint to preserve local geometry. In the second stage, a linear compression is implemented for the trade-off between the target dimension and the incurred information loss in excessive DR scenarios. Experiments are conducted on seven datasets with a neural network implementation of inv-ML, called i-ML-Enc. Empirically, i-ML-Enc achieves invertible DR in comparison with typical existing methods as well as reveals the characteristics of the learned manifolds. Through latent space interpolation on real-world datasets, we find that the reliability of tangent space approximated by the local neighborhood is the key to the success of manifold-based DR algorithms.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。