arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2109.11449stat.COstat.AP
收藏

在线预测的动态混合专家模型

Dynamic Mixture of Experts Models for Online Prediction

Parfait Munezero, Mattias Villani, Robert Kohn

摘要:

混合专家使用具有协变量相关混合权重的混合回归模型对响应变量的条件密度进行建模。我们扩展了有限混合专家模型,允许参数的混合成分和权重的演变,通过以下随机游动过程的时间。在丰富的参数化专家模型的混合中,时变参数的推断是具有挑战性的。我们提出了一个序贯蒙特卡罗算法的在线推理和定制的建议分布的基础上建立的想法,从线性贝叶斯方法和期望最大化算法。该方法给出了一个统一的处理与时变参数的混合物,包括静态参数的特殊情况。我们评估模拟数据和工业数据的目的是在一个不断升级的大型软件项目中预测软件故障的方法的属性。

英文摘要:

A mixture of experts models the conditional density of a response variable using a mixture of regression models with covariate-dependent mixture weights. We extend the finite mixture of experts model by allowing the parameters in both the mixture components and the weights to evolve in time by following random walk processes. Inference for time-varying parameters in richly parameterized mixture of experts models is challenging. We propose a sequential Monte Carlo algorithm for online inference and based on a tailored proposal distribution built on ideas from linear Bayes methods and the EM algorithm. The method gives a unified treatment for mixtures with time-varying parameters, including the special case of static parameters. We assess the properties of the method on simulated data and on industrial data where the aim is to predict software faults in a continuously upgraded large-scale software project.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑