arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1606.02054stat.CO
收藏

混合模型期望最大化算法的一种简单多线程实现

A simple multithreaded implementation of the EM algorithm for mixture models

Sharon X Lee, Kaleb L Lee, Geoffrey J McLachlan

摘要:

有限混合模型已被广泛用于异质群体数据的建模和分析。参数的极大似然估计通常通过期望最大化(EM)算法来执行。算法实现的复杂性取决于混合模型的组分密度所采用的参数分布。例如,在偏正态分布和偏t分布的情况下,E步将涉及计算昂贵的复杂表达式。对于大型和/或高维数据集,这可能非常耗时。在本文中,我们开发了一个多线程版本的期望最大化算法的有限混合模型的拟合。由于这些模型的算法结构,E-和M-步骤可以很容易地重新制定为跨多个线程并行执行,以利用现代多核机器中可用的处理能力。我们的方法简单且易于实现,只需要对标准代码进行很小的更改。为了说明这种方法,我们专注于一个相当一般的混合模型,其中包括一些最常用的混合模型,包括正常的,t-,斜态和斜t-混合模型的特殊或限制情况。

英文摘要:

Finite mixture models have been widely used for the modelling and analysis of data from heterogeneous populations. Maximum likelihood estimation of the parameters is typically carried out via the Expectation-Maximization (EM) algorithm. The complexity of the implementation of the algorithm depends on the parametric distribution that is adopted as the component densities of the mixture model. In the case of the skew normal and skew t-distributions, for example, the E-step would involve complicated expressions that are computationally expensive to evaluate. This can become quite time-consuming for large and/or high-dimensional datasets. In this paper, we develop a multithreaded version of the EM algorithm for the fitting of finite mixture models. Due to the structure of the algorithm for these models, the E- and M-steps can be easily reformulated to be executed in parallel across multiple threads to take advantage of the processing power available in modern-day multicore machines. Our approach is simple and easy to implement, requiring only small changes to standard code. To illustrate the approach, we focus on a fairly general mixture model that includes as special or limiting cases some of the most commonly used mixture models including the normal, t-, skew normal, and skew t-mixture models.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑