arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2111.04067cs.LGcs.DBcs.IR
收藏

多维尺度下的高性能样本外嵌入技术

High Performance Out-of-sample Embedding Techniques for Multidimensional Scaling

University of Adelaide(阿德莱德大学)

Samudra Herath, Matthew Roughan, Gary Glonek

摘要:

近年来,许多数据集的维数迅速增长,这意味着许多降维(DR)方法已经得到了极大的关注。需要高性能的DR算法来使数据分析适用于大而快的数据集。然而,许多传统的DR技术面临着真正的大型数据集的挑战。特别是多维缩放(MDS)不能很好地缩放。MDS是一组流行的DR技术,因为它可以对唯一输入是相异度函数的数据执行DR。然而,常见的方法在存储器和计算中至少是二次的,因此对于大规模数据是禁止的。我们提出了一个样本外嵌入(OSE)的解决方案来扩展MDS算法的大规模数据利用嵌入的给定数据的一个子集。我们提出了两种OSE技术:第一个基于优化方法和第二个基于神经网络模型。在近似中有一个小的折衷,样本外技术可以处理大规模的数据与合理的计算和内存需求。虽然这两种方法都表现良好,但神经网络模型在效率方面优于OSE解决方案的优化方法。OSE具有双重优势,它允许在流数据集和静态数据库上进行快速DR。

英文摘要:

The recent rapid growth of the dimension of many datasets means that many approaches to dimension reduction (DR) have gained significant attention. High-performance DR algorithms are required to make data analysis feasible for big and fast data sets. However, many traditional DR techniques are challenged by truly large data sets. In particular multidimensional scaling (MDS) does not scale well. MDS is a popular group of DR techniques because it can perform DR on data where the only input is a dissimilarity function. However, common approaches are at least quadratic in memory and computation and, hence, prohibitive for large-scale data. We propose an out-of-sample embedding (OSE) solution to extend the MDS algorithm for large-scale data utilising the embedding of only a subset of the given data. We present two OSE techniques: the first based on an optimisation approach and the second based on a neural network model. With a minor trade-off in the approximation, the out-of-sample techniques can process large-scale data with reasonable computation and memory requirements. While both methods perform well, the neural network model outperforms the optimisation approach of the OSE solution in terms of efficiency. OSE has the dual benefit that it allows fast DR on streaming datasets as well as static databases.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑