arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 1206.4672cs.LGstat.ML
收藏

层次聚类的有效主动算法

Efficient Active Algorithms for Hierarchical Clustering

Carnegie Mellon University(卡内基梅隆大学)

Akshay Krishnamurthy, Sivaraman Balakrishnan, Min Xu, Aarti Singh

摘要:

传感技术的进步和互联网的发展导致了现代数据集规模的爆炸式增长,而存储和处理能力仍然落后。这激发了对高效算法的需求,无论是在所需的测量数量还是运行时间方面。为了应对与大型数据集相关的挑战,我们提出了一个通用的主动层次聚类框架,该框架在小的数据子集上重复运行现成的聚类算法,并保证性能,测量复杂性和运行时复杂性。我们实例化这个框架与一个简单的谱聚类算法,并提供其性能的具体结果,表明,在某些假设下,该算法恢复所有集群的大小?(log对于一个包含n个对象的数据集,时间复杂度为O(n log^3 n)。通过大量的实验,我们也证明了这个框架实际上是诱人的。

英文摘要:

Advances in sensing technologies and the growth of the internet have resulted in an explosion in the size of modern datasets, while storage and processing power continue to lag behind. This motivates the need for algorithms that are efficient, both in terms of the number of measurements needed and running time. To combat the challenges associated with large datasets, we propose a general framework for active hierarchical clustering that repeatedly runs an off-the-shelf clustering algorithm on small subsets of the data and comes with guarantees on performance, measurement complexity and runtime complexity. We instantiate this framework with a simple spectral clustering algorithm and provide concrete results on its performance, showing that, under some assumptions, this algorithm recovers all clusters of size ?(log n) using O(n log^2 n) similarities and runs in O(n log^3 n) time for a dataset of n objects. Through extensive experimentation we also demonstrate that this framework is practically alluring.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑