arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2009.12875cs.LGcs.CVstat.ML
收藏

可伸缩归纳子空间聚类的自表达学习算法

Learning Self-Expression Metrics for Scalable and Inductive Subspace Clustering

Ludwig-Maximilians-Universität München(慕尼黑大学);Munich Center for Machine Learning (MCML)(慕尼黑机器学习中心)

Julian Busch, Evgeniy Faerman, Matthias Schubert, Thomas Seidl

摘要:

子空间聚类已经成为一种对高维数据进行聚类的最先进的方法。特别是,依赖于自我表达属性的方法最近被证明特别成功。然而,它们有两个主要缺点:第一,直接学习二次尺寸的系数矩阵,这阻止了这些方法扩展到小数据集之外。其次,经过训练的模型是传导性的,因此不能用于对训练期间未看到的样本外数据进行聚类。而不是学习自我表达系数直接,我们提出了一种新的度量学习方法来学习,而不是一个子空间的亲和函数使用连体神经网络架构。因此,我们的模型受益于恒定数量的参数和恒定大小的内存占用,使其能够扩展到相当大的数据集。此外,我们可以正式证明,我们的模型仍然能够准确地恢复子空间集群给定的独立性假设。连体架构结合一个新的几何分类器,进一步使我们的模型归纳,使其能够聚类样本外的数据。此外,通过简单地将自动编码器模块添加到架构中,可以检测非线性集群。然后,整个模型可以以自我监督的方式进行端到端的训练。这项正在进行的工作报告了MNIST数据集上有希望的初步结果。本着可复制研究的精神,我将所有代码公开。在未来的工作中,我们计划研究我们的模型的几个扩展,并扩大实验评估。

英文摘要:

Subspace clustering has established itself as a state-of-the-art approach to clustering high-dimensional data. In particular, methods relying on the self-expressiveness property have recently proved especially successful. However, they suffer from two major shortcomings: First, a quadratic-size coefficient matrix is learned directly, preventing these methods from scaling beyond small datasets. Secondly, the trained models are transductive and thus cannot be used to cluster out-of-sample data unseen during training. Instead of learning self-expression coefficients directly, we propose a novel metric learning approach to learn instead a subspace affinity function using a siamese neural network architecture. Consequently, our model benefits from a constant number of parameters and a constant-size memory footprint, allowing it to scale to considerably larger datasets. In addition, we can formally show that out model is still able to exactly recover subspace clusters given an independence assumption. The siamese architecture in combination with a novel geometric classifier further makes our model inductive, allowing it to cluster out-of-sample data. Additionally, non-linear clusters can be detected by simply adding an auto-encoder module to the architecture. The whole model can then be trained end-to-end in a self-supervised manner. This work in progress reports promising preliminary results on the MNIST dataset. In the spirit of reproducible research, me make all code publicly available. In future work we plan to investigate several extensions of our model and to expand experimental evaluation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑