arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2101.12686stat.AP
收藏

银河数据集中有多少数据簇?贝叶斯聚类分析

How many data clusters are in the Galaxy data set? Bayesian cluster analysis in action

Bettina Grün, Gertraud Malsiner-Walli, Sylvia Frühwirth-Schnatter

摘要:

在基于模型的聚类中,Galaxy数据集通常被用作基准数据集,以研究不同建模方法的性能。Aitkin(2001年)比较了银河数据集的极大似然分析和贝叶斯分析,并对贝叶斯方法表示保留,因为所采用的事先假设仍然相当模糊,但在所获得的结果和得出的结论中起着重要作用。本文的目的是解决艾特金的关注的贝叶斯方法,阐明如何指定的先验影响估计集群的数量。我们对有限混合模型的混合模型进行了不同先验规范的敏感性分析,该混合模型包括关于组分数量的先验。我们使用一个全面的析因设计,并评估其对银河数据集的聚类估计数的影响,一套广泛的不同的先验规范。结果突出了先前规格的相互作用的影响,并提供了建议,以获得一个稀疏的聚类解决方案的先验规格的见解。人工数据的模拟研究提供了进一步的经验证据来支持建议。对先验规范影响的清晰理解消除了由于选择合适先验的复杂性而阻止使用贝叶斯方法的限制。此外,可以有意地利用先验的正则化属性来获得满足应用的先验期望和需求的合适的聚类解决方案。

英文摘要:

In model-based clustering, the Galaxy data set is often used as a benchmark data set to study the performance of different modeling approaches. Aitkin (2001) compares maximum likelihood and Bayesian analyses of the Galaxy data set and expresses reservations about the Bayesian approach due to the fact that the prior assumptions imposed remain rather obscure while playing a major role in the results obtained and conclusions drawn. The aim of the paper is to address Aitkin's concerns about the Bayesian approach by shedding light on how the specified priors influence the number of estimated clusters. We perform a sensitivity analysis of different prior specifications for the mixtures of finite mixture model, i.e., the mixture model where a prior on the number of components is included. We use an extensive set of different prior specifications in a full factorial design and assess their impact on the estimated number of clusters for the Galaxy data set. Results highlight the interaction effects of the prior specifications and provide insights into which prior specifications are recommended to obtain a sparse clustering solution. A simulation study with artificial data provides further empirical evidence to support the recommendations. A clear understanding of the impact of the prior specifications removes restraints preventing the use of Bayesian methods due to the complexity of selecting suitable priors. Also, the regularizing properties of the priors may be intentionally exploited to obtain a suitable clustering solution meeting prior expectations and needs of the application.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑