SMLSOM:收缩最大似然自组织映射
SMLSOM: The shrinking maximum likelihood self-organizing map
摘要:
确定数据集中的聚类数是数据聚类中的一个基本问题。已经提出了许多方法来解决选择聚类数的问题,认为这是一个关于模型选择的问题。本文提出了一种有效的算法,自动选择一个合适的数量的集群的基础上的概率分布模型框架。该算法包括以下两个部分。首先,介绍了Kohonen自组织映射(SOM)的推广。在Kohonen的SOM中,聚类被建模为均值向量。在广义SOM中,每个聚类被建模为概率分布,并由基于似然分类的样本构成。其次,介绍了SOM网络结构的动态更新方法。在Kohonen的SOM中,每个聚类都被绑定到一个固定的二维格空间的节点上,并使用基于欧几里得距离的节点之间的邻域关系来学习。扩展的SOM定义了一个以簇为顶点、以邻域关系为连接的图,并通过删除弱连接和不必要的顶点来更新图的结构。用Kullback-Leibler散度度量链路的弱点,用最小描述长度度量顶点的冗余度。这些扩展使得确定簇的适当数量变得高效。与现有的方法相比,该方法计算效率高,可以准确地选择簇的数量。
英文摘要:
Determining the number of clusters in a dataset is a fundamental issue in data clustering. Many methods have been proposed to solve the problem of selecting the number of clusters, considering it to be a problem with regard to model selection. This paper proposes an efficient algorithm that automatically selects a suitable number of clusters based on a probability distribution model framework. The algorithm includes the following two components. First, a generalization of Kohonen's self-organizing map (SOM) is introduced. In Kohonen's SOM, clusters are modeled as mean vectors. In the generalized SOM, each cluster is modeled as a probabilistic distribution and constructed by samples classified based on the likelihood. Second, the dynamically updating method of the SOM structure is introduced. In Kohonen's SOM, each cluster is tied to a node of a fixed two-dimensional lattice space and learned using neighborhood relations between nodes based on Euclidean distance. The extended SOM defines a graph with clusters as vertices and neighborhood relations as links and updates the graph structure by cutting weakly-connection and unnecessary vertex deletions. The weakness of a link is measured using the Kullback--Leibler divergence, and the redundancy of a vertex is measured using the minimum description length. Those extensions make it efficient to determine the appropriate number of clusters. Compared with existing methods, the proposed method is computationally efficient and can accurately select the number of clusters.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。