arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1806.02160stat.ME
收藏

深度贝叶斯回归模型

Deep Bayesian regression models

Aliaksandr Hubin, Geir Storvik, Florian Frommlet

摘要:

回归模型在广泛的应用中用于推理和预测,为来自不同领域的研究人员和分析师提供了强大的科学工具。在许多研究领域,可用数据的数量以及潜在的解释变量的数量正在迅速增加。变量选择和模型平均已成为改进推断和预测的极其重要的工具。然而,通常线性模型是不够的,并且通过引入非线性和复杂的函数相互作用来更好地描述输入变量和响应之间的复杂关系。深度学习模型在预测方面非常成功,尽管它们通常很难指定,并且可能会受到过度拟合的影响。本文的目的是将深度学习的思想引入一个统计框架,从而产生更简约的模型,并允许量化模型的不确定性。为此,我们引入了一类深度贝叶斯回归模型(DBRM),它由一个广义线性模型和一个全面的非线性特征空间组成,其中非线性特征的生成就像深度学习一样,但与变量选择相结合,以便只包括重要的特征。DBRM可以很容易地扩展到包括潜在的高斯变量,以模拟观察之间的复杂相关结构,这似乎不容易与现有的深度学习方法。介绍了两种基于MCMC的算法来拟合DBRM和进行贝叶斯推断。这些算法的预测性能进行了比较与大量的最先进的算法。此外,我们说明了如何DBRM可以用于模型推理在各种应用程序。

英文摘要:

Regression models are used for inference and prediction in a wide range of applications providing a powerful scientific tool for researchers and analysts from different fields. In many research fields the amount of available data as well as the number of potential explanatory variables is rapidly increasing. Variable selection and model averaging have become extremely important tools for improving inference and prediction. However, often linear models are not sufficient and the complex relationship between input variables and a response is better described by introducing non-linearities and complex functional interactions. Deep learning models have been extremely successful in terms of prediction although they are often difficult to specify and potentially suffer from overfitting. The aim of this paper is to bring the ideas of deep learning into a statistical framework which yields more parsimonious models and allows to quantify model uncertainty. To this end we introduce the class of deep Bayesian regression models (DBRM) consisting of a generalized linear model combined with a comprehensive non-linear feature space, where non-linear features are generated just like in deep learning but combined with variable selection in order to include only important features. DBRM can easily be extended to include latent Gaussian variables to model complex correlation structures between observations, which seems to be not easily possible with existing deep learning approaches. Two different algorithms based on MCMC are introduced to fit DBRM and to perform Bayesian inference. The predictive performance of these algorithms is compared with a large number of state of the art algorithms. Furthermore we illustrate how DBRM can be used for model inference in various applications.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑