arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2404.09243cs.LGcs.NE
收藏

学习自生长地图以实现快速准确的不平衡流数据聚类

Learning Self-Growth Maps for Fast and Accurate Imbalanced Streaming Data Clustering

School of Computer Science and Technology, Guangdong University of Technology(广东工业大学计算机科学与技术学院);Department of Computer Science, Hong Kong Baptist University(香港 Baptist 大学计算机科学系)

Yiqun Zhang, Sen Feng, Pengkai Wang, Zexi Tan, Xiaopeng Luo, Yuzhu Ji, Rong Zou, Yiu-ming Cheung

AI总结:

本文提出SOHI方法,通过自生长地图和层次合并策略,实现对流数据不平衡聚类的快速准确探索。

摘要:

流数据聚类是数据挖掘和机器学习中的热门研究课题。由于流数据通常是按数据块进行分析的,因此更容易遇到动态聚类不平衡问题。也就是说,聚类的不平衡比率会随时间变化,这很容易导致流数据聚类的准确率或效率出现波动。因此,我们提出了一种准确且高效的流数据聚类方法,以适应漂移和不平衡的聚类分布。我们首先设计了一个自生长地图(SGM),可以根据局部分布自动安排神经元,从而实现快速且渐进的适应于流分布。由于SGM为描述全局分布分配了过多的密度敏感神经元,因此可以避免在不平衡分布中遗漏小聚类。我们还提出了一种快速的层次合并策略,用于合并打破相对较大聚类的神经元。它利用维护的SGM快速检索聚类内的分布对以进行合并,从而避免了最繁琐的全局搜索。结果表明,所提出的SGM可以渐进适应新块的分布,而自生长地图引导的不平衡数据聚类(SOHI)方法可以快速探索真实的不平衡聚类数量。广泛的实验表明,SOHI能够高效且准确地探索流数据的聚类分布。

英文摘要:

Streaming data clustering is a popular research topic in data mining and machine learning. Since streaming data is usually analyzed in data chunks, it is more susceptible to encounter the dynamic cluster imbalance issue. That is, the imbalance ratio of clusters changes over time, which can easily lead to fluctuations in either the accuracy or the efficiency of streaming data clustering. Therefore, we propose an accurate and efficient streaming data clustering approach to adapt the drifting and imbalanced cluster distributions. We first design a Self-Growth Map (SGM) that can automatically arrange neurons on demand according to local distribution, and thus achieve fast and incremental adaptation to the streaming distributions. Since SGM allocates an excess number of density-sensitive neurons to describe the global distribution, it can avoid missing small clusters among imbalanced distributions. We also propose a fast hierarchical merging strategy to combine the neurons that break up the relatively large clusters. It exploits the maintained SGM to quickly retrieve the intra-cluster distribution pairs for merging, which circumvents the most laborious global searching. It turns out that the proposed SGM can incrementally adapt to the distributions of new chunks, and the Self-grOwth map-guided Hierarchical merging for Imbalanced data clustering (SOHI) approach can quickly explore a true number of imbalanced clusters. Extensive experiments demonstrate that SOHI can efficiently and accurately explore cluster distributions for streaming data.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑