arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1609.06533stat.MLcs.LG
收藏

混合聚类中基于密度的相异性度量的数据无关性研究

On Data-Independent Properties for Density-Based Dissimilarity Measures in Hybrid Clustering

Norwegian Centre for Integrated Care and Telemedicine, University Hospital of North Norway(挪威北部大学医院综合护理与远程医疗中心);Department of Mathematics and Statistics, IIT Kanpur(印度理工学院坎普尔分校数学与统计系);Department of Mathematics and Statistics, UiT The Arctic University of Norway(挪威北极大学数学与统计系)

Kajsa Møllersen, Subhra S. Dhar, Fred Godtliebsen

摘要:

混合聚类结合了分区和层次聚类,以提高计算效率和聚类形状的通用性。在这样的聚类中,相异性度量在分层合并中起着至关重要的作用。相异性度量对最终的聚类有很大的影响,并且需要数据独立的属性来为手头的问题选择正确的相异性度量。基于距离的相异度度量的性质已经研究了几十年,但基于密度的相异度度量的性质迄今为止很少受到关注。在这里,我们提出了六个数据独立的属性来评估与混合聚类相关的基于密度的相异性度量,关于平等,正交性,对称性,离群值和噪声观测,以及重尾集群的轻尾模型。研究了这些性质的意义,并基于Shannon熵、误分类率、Bhattacharyya距离和库尔贝克-莱布勒散度研究了一些著名的相异度度量.由于它们都不满足所有提出的性质,我们引入了一个新的相异度的Kullback-Leibler信息的基础上,并证明它满足所有提出的性质。所提出的属性的效果也说明了几个真实的和模拟的数据集。

英文摘要:

Hybrid clustering combines partitional and hierarchical clustering for computational effectiveness and versatility in cluster shape. In such clustering, a dissimilarity measure plays a crucial role in the hierarchical merging. The dissimilarity measure has great impact on the final clustering, and data-independent properties are needed to choose the right dissimilarity measure for the problem at hand. Properties for distance-based dissimilarity measures have been studied for decades, but properties for density-based dissimilarity measures have so far received little attention. Here, we propose six data-independent properties to evaluate density-based dissimilarity measures associated with hybrid clustering, regarding equality, orthogonality, symmetry, outlier and noise observations, and light-tailed models for heavy-tailed clusters. The significance of the properties is investigated, and we study some well-known dissimilarity measures based on Shannon entropy, misclassification rate, Bhattacharyya distance and Kullback-Leibler divergence with respect to the proposed properties. As none of them satisfy all the proposed properties, we introduce a new dissimilarity measure based on the Kullback-Leibler information and show that it satisfies all proposed properties. The effect of the proposed properties is also illustrated on several real and simulated data sets.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑