arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2009.04822stat.MLcs.LG
收藏

广义多输出高斯过程删失回归

Generalized Multi-Output Gaussian Process Censored Regression

Technical University of Denmark(丹麦技术大学)

Daniele Gammelli, Kasper Pryds Rolsted, Dario Pacino, Filipe Rodrigues

摘要:

当对删失观测建模时,当前回归方法中的典型方法是使用删失高斯(即Tobit)模型来描述条件输出分布。在本文中,在缺失数据的情况下,我们认为,利用多个输出之间的相关性,可以使模型更好地解决由删失数据引入的偏差。为此,我们引入了一个异方差多输出高斯过程模型,该模型结合了GP的非参数灵活性和在依赖于输入的噪声条件下利用相关输出信息的能力。为了解决由此产生的推理棘手,我们进一步设计了一个变分的边界适合于随机最优化的边际对数似然。我们根据经验评估我们的模型对其他生成模型的审查数据的合成和现实世界的任务,并进一步展示它如何可以推广到处理任意似然函数。结果表明,增加的灵活性如何使我们的模型能够更好地估计潜在的非删失(即真实)过程下潜在的复杂的删失动态。

英文摘要:

When modelling censored observations, a typical approach in current regression methods is to use a censored-Gaussian (i.e. Tobit) model to describe the conditional output distribution. In this paper, as in the case of missing data, we argue that exploiting correlations between multiple outputs can enable models to better address the bias introduced by censored data. To do so, we introduce a heteroscedastic multi-output Gaussian process model which combines the non-parametric flexibility of GPs with the ability to leverage information from correlated outputs under input-dependent noise conditions. To address the resulting inference intractability, we further devise a variational bound to the marginal log-likelihood suitable for stochastic optimization. We empirically evaluate our model against other generative models for censored data on both synthetic and real world tasks and further show how it can be generalized to deal with arbitrary likelihood functions. Results show how the added flexibility allows our model to better estimate the underlying non-censored (i.e. true) process under potentially complex censoring dynamics.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑