arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2003.02929stat.MLcs.LGstat.COstat.ME
收藏

灵活的贝叶斯非线性模型配置

Flexible Bayesian Nonlinear Model Configuration

University of Oslo(奥斯陆大学);Norwegian Computing Center(挪威计算中心);Medical University of Vienna(维也纳医科大学)

Aliaksandr Hubin, Geir Storvik, Florian Frommlet

摘要:

回归模型被广泛应用于各种领域,为不同领域的研究人员提供了强大的科学工具。线性或简单的参数模型通常不足以描述输入变量和响应之间的复杂关系。这种关系可以通过灵活的方法(如神经网络)更好地描述,但这会导致更少的可解释模型和潜在的过拟合。可替代地,可以使用特定的参数非线性函数,但是这样的函数的规范通常是复杂的。在本文中,我们介绍了一个灵活的方法,高度灵活的非线性参数回归模型的建设和选择。非线性特征是分层生成的,类似于深度学习,但在要考虑的可能特征类型上具有额外的灵活性。这种灵活性与变量选择相结合,使我们能够找到一小部分重要的特征,从而找到更可解释的模型。在可能的功能的空间内,贝叶斯方法,根据其复杂性引入先验的功能,被认为是。采用遗传改进的跳模马尔可夫链蒙特卡罗算法进行贝叶斯推断,估计模型平均的后验概率。在各种应用中,我们说明了如何使用我们的方法来获得有意义的非线性模型。此外,我们将其预测性能与几种机器学习算法进行了比较。

英文摘要:

Regression models are used in a wide range of applications providing a powerful scientific tool for researchers from different fields. Linear, or simple parametric, models are often not sufficient to describe complex relationships between input variables and a response. Such relationships can be better described through flexible approaches such as neural networks, but this results in less interpretable models and potential overfitting. Alternatively, specific parametric nonlinear functions can be used, but the specification of such functions is in general complicated. In this paper, we introduce a flexible approach for the construction and selection of highly flexible nonlinear parametric regression models. Nonlinear features are generated hierarchically, similarly to deep learning, but have additional flexibility on the possible types of features to be considered. This flexibility, combined with variable selection, allows us to find a small set of important features and thereby more interpretable models. Within the space of possible functions, a Bayesian approach, introducing priors for functions based on their complexity, is considered. A genetically modified mode jumping Markov chain Monte Carlo algorithm is adopted to perform Bayesian inference and estimate posterior probabilities for model averaging. In various applications, we illustrate how our approach is used to obtain meaningful nonlinear models. Additionally, we compare its predictive performance with several machine learning algorithms.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑