arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2201.02030stat.MEstat.AP
收藏

基于核密度估计的聚类评价新方法

A new measure for assessment of clustering based on kernel density estimation

Soumita Modak

摘要:

提出了一种新的聚类精度测度,用于确定未知的聚类数,并对任意维空间中给定数据集的聚类质量进行评估。我们的有效性指标适用于经典的非参数单变量核密度估计方法之间的点间距离计算的数据的成员。由于它基于点间距离,因此不受维度灾难的影响,因此对于研究变量数量可能大于样本量的高维情况可以有效计算。所提出的措施是兼容的任何聚类算法,并与每一种数据集的点间距离测量可以定义为具有密度函数。模拟研究证明了它的优越性,广泛使用的集群有效性指标,如平均轮廓宽度和邓恩指数,而它的适用性方面的高维Alon数据集的生物统计研究和大型天文统计应用的时间序列与新的变星的光变曲线。

英文摘要:

A new clustering accuracy measure is proposed to determine the unknown number of clusters and to assess the quality of clustering of a data set given in any dimensional space. Our validity index applies the classical nonparametric univariate kernel density estimation method to the interpoint distances computed between the members of data. Being based on interpoint distances, it is free of the curse of dimensionality and therefore efficiently computable for high-dimensional situations where the number of study variables can be larger than the sample size. The proposed measure is compatible with any clustering algorithm and with every kind of data set where the interpoint distance measure can be defined to have a density function. Simulation study proves its superiority over widely used cluster validity indices like the average silhouette width and the Dunn index, whereas its applicability is shown with respect to a high-dimensional Biostatistical study of Alon data set and a large Astrostatistical application of time series with light curves of new variable stars.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑