含噪高维数据的多维尺度
Multidimensional Scaling of Noisy High Dimensional Data
摘要:
多维尺度(MDS)是一种用于在低维中嵌入数据的经典技术,至今仍在广泛使用。MDS最初是在20世纪50年代引入的,在设计时并没有考虑到高维数据;虽然它仍然受到数据分析从业者的欢迎,但毫无疑问,它应该适应高维数据体系。在本文中,我们研究MDS下的现代设置,特别是,高维和环境测量噪声。我们发现,随着环境噪声水平的增加,MDS遭受急剧的崩溃,依赖于数据的维数和噪声水平,并推导出一个明确的公式,这个崩溃点的情况下,白噪声。然后,我们介绍MDS+,MDS的一个非常简单的变种,它适用于仔细推导收缩非线性MDS相似矩阵的特征值。在衡量嵌入质量的损失函数下,MDS+是唯一的渐近最优收缩函数。我们证明,MDS+提供改进的嵌入,有时显着,与经典的MDS相比。此外,MDS+不需要对嵌入维数进行外部估计(这是经典MDS中的一个著名难题),因为它会计算数据应该嵌入的最佳维数。
英文摘要:
Multidimensional Scaling (MDS) is a classical technique for embedding data in low dimensions, still in widespread use today. Originally introduced in the 1950's, MDS was not designed with high-dimensional data in mind; while it remains popular with data analysis practitioners, no doubt it should be adapted to the high-dimensional data regime. In this paper we study MDS under modern setting, and specifically, high dimensions and ambient measurement noise. We show that, as the ambient noise level increase, MDS suffers a sharp breakdown that depends on the data dimension and noise level, and derive an explicit formula for this breakdown point in the case of white noise. We then introduce MDS+, an extremely simple variant of MDS, which applies a carefully derived shrinkage nonlinearity to the eigenvalues of the MDS similarity matrix. Under a loss function measuring the embedding quality, MDS+ is the unique asymptotically optimal shrinkage function. We prove that MDS+ offers improved embedding, sometimes significantly so, compared with classical MDS. Furthermore, MDS+ does not require external estimates of the embedding dimension (a famous difficulty in classical MDS), as it calculates the optimal dimension into which the data should be embedded.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。