arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 0912.3408stat.MLmath.STstat.TH
收藏

用于噪声聚类识别的k-最近邻图的优化构造

Optimal construction of k-nearest neighbor graphs for identifying noisy clusters

Markus Maier, Matthias Hein, Ulrike von Luxburg

摘要:

研究了基于邻域图的随机样本数据点聚类算法。我们要问的问题是如何构建这样的图,以获得最佳的聚类结果。应该选择哪种类型的邻域图,相互k-最近邻还是对称k-最近邻?最佳参数k是多少?在我们的设置中,聚类被定义为底层概率分布的t水平集的连通分量。如果图中的连通分量对应于真正的底层聚类,则聚类被称为在邻域图中被标识。使用随机几何图论的技术,我们证明了成功识别集群的概率上的界限,无论是在一个无噪声和嘈杂的设置。这些界限导致了几个结论。首先,k必须选择得出奇的高(而不是n阶,而不是log n阶),以最大化聚类识别的概率。其次,当人们试图只检测最重要的聚类时,相互和对称k-最近邻图之间的主要差异发生。

英文摘要:

We study clustering algorithms based on neighborhood graphs on a random sample of data points. The question we ask is how such a graph should be constructed in order to obtain optimal clustering results. Which type of neighborhood graph should one choose, mutual k-nearest neighbor or symmetric k-nearest neighbor? What is the optimal parameter k? In our setting, clusters are defined as connected components of the t-level set of the underlying probability distribution. Clusters are said to be identified in the neighborhood graph if connected components in the graph correspond to the true underlying clusters. Using techniques from random geometric graph theory, we prove bounds on the probability that clusters are identified successfully, both in a noise-free and in a noisy setting. Those bounds lead to several conclusions. First, k has to be chosen surprisingly high (rather of the order n than of the order log n) to maximize the probability of cluster identification. Secondly, the major difference between the mutual and the symmetric k-nearest neighbor graph occurs when one attempts to detect the most significant cluster only.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑