arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1403.2137stat.AP
收藏

大数据集混合模型的重标记算法

Relabelling Algorithms for Large Dataset Mixture Models

Wanchuang Zhu, Yanan Fan

摘要:

混合模型在密度估计和分类问题中是灵活的工具。这种模型的贝叶斯估计通常依赖于使用马尔可夫链蒙特卡罗从后验分布中采样。标签切换出现,因为后验是不变的组件参数的排列。文献中已经对处理标签切换的方法进行了相当广泛的研究,其中最流行的方法是基于损失函数的方法。然而,这些算法中的许多在实践中变得太慢,并且随着数据的大小和维度的增长而变得不可行。在这篇文章中,我们回顾了早期的解决方案,这些解决方案可以很好地扩展到大数据集,并比较了它们在模拟和真实数据集上的性能。此外,我们提出了一个新的,计算效率高的算法的基础上的损失函数的解释,并表明它可以扩展到更大的问题。最后,我们对所有研究方法进行了一些讨论和建议。

英文摘要:

Mixture models are flexible tools in density estimation and classification problems. Bayesian estimation of such models typically relies on sampling from the posterior distribution using Markov chain Monte Carlo. Label switching arises because the posterior is invariant to permutations of the component parameters. Methods for dealing with label switching have been studied fairly extensively in the literature, with the most popular approaches being those based on loss functions. However, many of these algorithms turn out to be too slow in practice, and can be infeasible as the size and dimension of the data grow. In this article, we review earlier solutions which can scale up well for large data sets, and compare their performances on simulated and real datasets. In addition, we propose a new, and computationally efficient algorithm based on a loss function interpretation, and show that it can scale up well in larger problems. We conclude with some discussions and recommendations of all the methods studied.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑