arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2011.07866cs.LGstat.COstat.MEstat.ML
收藏

基于多任务高斯过程的企业特定预测

Cluster-Specific Predictions with Multi-Task Gaussian Processes

The University of Manchester(曼彻斯特大学);Université de Paris(巴黎大学);CNRS(法国国家科学研究中心);Inria(法国国家信息与自动化研究所);University College London(伦敦大学学院)

Arthur Leroy, Pierre Latouche, Benjamin Guedj, Servane Gey

摘要:

引入了一种涉及高斯过程(GP)的模型,以同时处理多个功能数据的多任务学习,聚类和预测。该过程作为功能数据的基于模型的聚类方法,以及新任务后续预测的学习步骤。该模型被实例化为具有共同平均过程的多任务GP的混合物。一个变分EM算法,用于处理超参数的优化以及潜变量和过程的超后验估计。我们建立明确的公式,整合的平均过程和潜在的聚类变量的预测分布,占两个方面的不确定性。这种分布被定义为特定于集群的GP预测的混合,这增强了处理组结构数据时的性能。该模型处理不规则的观察网格,并提供不同的假设的协方差结构共享额外的信息跨任务。通过各种模拟场景和真实数据集评估聚类和预测任务的性能。整个算法称为MagmaClust,作为R包公开提供。

英文摘要:

A model involving Gaussian processes (GPs) is introduced to simultaneously handle multi-task learning, clustering, and prediction for multiple functional data. This procedure acts as a model-based clustering method for functional data as well as a learning step for subsequent predictions for new tasks. The model is instantiated as a mixture of multi-task GPs with common mean processes. A variational EM algorithm is derived for dealing with the optimisation of the hyper-parameters along with the hyper-posteriors' estimation of latent variables and processes. We establish explicit formulas for integrating the mean processes and the latent clustering variables within a predictive distribution, accounting for uncertainty on both aspects. This distribution is defined as a mixture of cluster-specific GP predictions, which enhances the performances when dealing with group-structured data. The model handles irregular grid of observations and offers different hypotheses on the covariance structure for sharing additional information across tasks. The performances on both clustering and prediction tasks are assessed through various simulated scenarios and real datasets. The overall algorithm, called MagmaClust, is publicly available as an R package.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑