arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 1602.00370cs.LGcs.HC
收藏

可视化大规模和高维数据

Visualizing Large-scale and High-dimensional Data

Microsoft Research Asia(微软亚洲研究院);Peking University(北京大学);University of Michigan(密歇根大学)

Jian Tang, Jingzhou Liu, Ming Zhang, Qiaozhu Mei

摘要:

我们研究了在低维(通常是2D或3D)空间中可视化大规模和高维数据的问题。最近已经报道了很多成功的技术,首先计算数据点的相似性结构,然后将它们投影到一个低维空间中,保留结构。这两个步骤遭受相当大的计算成本,阻止了诸如t-SNE的现有技术方法缩放到大规模和高维数据(例如,数百万个数据点和数百个维度)。我们提出了LargeVis,这是一种技术,首先从数据中构建一个精确近似的K-最近邻图,然后在低维空间中布局该图。与t-SNE相比,LargeVis显着降低了图形构建步骤的计算成本,并为可视化步骤采用了原则性概率模型,其目标可以通过异步随机梯度下降以线性时间复杂度进行有效优化。因此,整个过程很容易扩展到数百万个高维数据点。在真实数据集上的实验结果表明,LargeVis在效率和有效性方面都优于最先进的方法。LargeVis的超参数在不同的数据集上也更加稳定。

英文摘要:

We study the problem of visualizing large-scale and high-dimensional data in a low-dimensional (typically 2D or 3D) space. Much success has been reported recently by techniques that first compute a similarity structure of the data points and then project them into a low-dimensional space with the structure preserved. These two steps suffer from considerable computational costs, preventing the state-of-the-art methods such as the t-SNE from scaling to large-scale and high-dimensional data (e.g., millions of data points and hundreds of dimensions). We propose the LargeVis, a technique that first constructs an accurately approximated K-nearest neighbor graph from the data and then layouts the graph in the low-dimensional space. Comparing to t-SNE, LargeVis significantly reduces the computational cost of the graph construction step and employs a principled probabilistic model for the visualization step, the objective of which can be effectively optimized through asynchronous stochastic gradient descent with a linear time complexity. The whole procedure thus easily scales to millions of high-dimensional data points. Experimental results on real-world data sets demonstrate that the LargeVis outperforms the state-of-the-art methods in both efficiency and effectiveness. The hyper-parameters of LargeVis are also much more stable over different data sets.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑