arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.04698cs.LG
收藏

高维数据流的层次稀疏表示聚类

Hierarchical Sparse Representation Clustering for High-Dimensional Data Streams

College of Computer Science, Sichuan University(四川大学计算机科学学院);Department of Computer and Information Sciences, Northumbria University(北诺布里亚大学计算机与信息科学系)

Jie Chen, Hua Mao, Yuanbiao Gou, Xi Peng

AI总结:

针对高维数据流聚类中欧氏距离失效和噪声敏感问题,提出层次稀疏表示聚类方法HSRC,利用$l_1$-minimization和谱聚类生成并合并微簇,通过稀疏残差值自适应选择代表样本并检测离群点,实验证明其有效且鲁棒。

摘要:

数据流聚类旨在从持续到达、潜在无界的数据序列中发现模式。已有许多数据流算法被提出用于聚类数据流。然而,现有数据流聚类算法在处理高维数据流时仍面临重大挑战。首先,在构建和合并微簇时,难以通过欧几里得距离度量高维数据对象间的相似性。其次,这些算法对高维数据流中包含的噪声高度敏感。本文提出了一种用于聚类高维数据流的层次稀疏表示聚类(HSRC)方法。HSRC首先采用$l_1$-minimization技术,为固定大小的单个地标窗口中的数据对象学习亲和矩阵,其中相邻数据对象的数量被自动选择。该方法确保簇内高度相关的数据样本被分在一组。然后,HSRC对亲和矩阵应用谱聚类技术以生成微簇。这些微簇随后基于其稀疏相似度(SSD)被合并为宏簇。此外,HSRC引入稀疏残差值(SRV),从当前地标窗口中自适应地选择代表性数据对象。这些代表作为下一个地标窗口的字典样本。最后,HSRC通过微调优化每个宏簇。特别地,HSRC能够通过关联的SRV检测高维数据流中的离群点。在几个基准数据集上获得的实验结果证明了HSRC的有效性和鲁棒性。

英文摘要:

Data stream clustering reveals patterns within continuously arriving, potentially unbounded data sequences. Numerous data stream algorithms have been proposed to cluster data streams. The existing data stream clustering algorithms still face significant challenges when addressing high-dimensional data streams. First, it is intractable to measure the similarities among high-dimensional data objects via Euclidean distances when constructing and merging microclusters. Second, these algorithms are highly sensitive to the noise contained in high-dimensional data streams. In this paper, we propose a hierarchical sparse representation clustering (HSRC) method for clustering high-dimensional data streams. HSRC first employs an $l_1$-minimization technique to learn an affinity matrix for data objects in individual landmark windows with fixed sizes, where the number of neighboring data objects is automatically selected. This approach ensures that highly correlated data samples within clusters are grouped together. Then, HSRC applies a spectral clustering technique to the affinity matrix to generate microclusters. These microclusters are subsequently merged into macroclusters based on their sparse similarity degrees (SSDs). Additionally, HSRC introduces sparsity residual values (SRVs) to adaptively select representative data objects from the current landmark window. These representatives serve as dictionary samples for the next landmark window. Finally, HSRC refines each macrocluster through fine-tuning. In particular, HSRC enables the detection of outliers in high-dimensional data streams via the associated SRVs. The experimental results obtained on several benchmark datasets demonstrate the effectiveness and robustness of HSRC.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑