arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1509.01546stat.MLcs.LG
收藏

最小谱连通投影寻踪

Minimum Spectral Connectivity Projection Pursuit

Stellenbosch University(斯泰伦博斯大学);Lancaster University(兰卡斯特大学)

David P. Hofmeyr, Nicos G. Pavlidis, Idris A. Eckley

摘要:

我们研究的问题,确定最佳的低维投影最大化的二进制分区的未标记的数据集的可分性,测量谱图理论。这是通过找到最小化投影数据的图拉普拉斯算子的第二特征值的投影来实现的,这对应于非凸的、非光滑的优化问题。我们表明,最佳的单变量投影的基础上的频谱连接收敛到向量正常的最大利润超平面通过数据,作为缩放参数减少到零。这就建立了由谱图理论测量的连通性和最大欧几里得分离之间的联系。与每个特征值问题相关的计算成本是数据数量的二次方。为了缓解这个问题,我们提出了一种近似方法,使用微簇可证明的近似误差界。在一个分裂的层次模型中结合多个二进制分区,使我们能够构建聚类解决方案,允许不同规模的集群和不同的子空间。我们评估了所提出的方法在大量基准数据集上的性能,发现它与现有的投影寻踪和数据聚类的降维方法相比毫不逊色。

英文摘要:

We study the problem of determining the optimal low dimensional projection for maximising the separability of a binary partition of an unlabelled dataset, as measured by spectral graph theory. This is achieved by finding projections which minimise the second eigenvalue of the graph Laplacian of the projected data, which corresponds to a non-convex, non-smooth optimisation problem. We show that the optimal univariate projection based on spectral connectivity converges to the vector normal to the maximum margin hyperplane through the data, as the scaling parameter is reduced to zero. This establishes a connection between connectivity as measured by spectral graph theory and maximal Euclidean separation. The computational cost associated with each eigen-problem is quadratic in the number of data. To mitigate this issue, we propose an approximation method using microclusters with provable approximation error bounds. Combining multiple binary partitions within a divisive hierarchical model allows us to construct clustering solutions admitting clusters with varying scales and lying within different subspaces. We evaluate the performance of the proposed method on a large collection of benchmark datasets and find that it compares favourably with existing methods for projection pursuit and dimension reduction for data clustering.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑