arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2001.08677cs.LGstat.ML

Towards Automatic Clustering Analysis using Traces of Information Gain: The InfoGuide Method

University of Pernambuco(伯南布哥大学);University of California, Davis(加利福尼亚大学戴维斯分校)

Paulo Rocha, Diego Pinheiro, Martin Cadeiras, Carmelo Bastos-Filho

英文摘要:

Clustering analysis has become a ubiquitous information retrieval tool in a wide range of domains, but a more automatic framework is still lacking. Though internal metrics are the key players towards a successful retrieval of clusters, their effectiveness on real-world datasets remains not fully understood, mainly because of their unrealistic assumptions underlying datasets. We hypothesized that capturing {\it traces of information gain} between increasingly complex clustering retrievals---{\it InfoGuide}---enables an automatic clustering analysis with improved clustering retrievals. We validated the {\it InfoGuide} hypothesis by capturing the traces of information gain using the Kolmogorov-Smirnov statistic and comparing the clusters retrieved by {\it InfoGuide} against those retrieved by other commonly used internal metrics in artificially-generated, benchmarks, and real-world datasets. Our results suggested that {\it InfoGuide} can enable a more automatic clustering analysis and may be more suitable for retrieving clusters in real-world datasets displaying nontrivial statistical properties.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑