arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1903.07320stat.MLcs.LG
收藏

用于多保真度建模的深度高斯过程

Deep Gaussian Processes for Multi-fidelity Modeling

EURECOM;Amazon(亚马逊)

Kurt Cutajar, Mark Pullin, Andreas Damianou, Neil Lawrence, Javier González

摘要:

当廉价获得但可能有偏差和噪声的观测必须与有限或昂贵的真实数据有效结合以构建可靠的模型时,多保真度方法被突出地使用。这既出现在基本的机器学习过程中,如贝叶斯优化,也出现在更实际的科学和工程应用中。在本文中,我们开发了一种新的多保真度模型,它把一个深高斯过程的层的保真度水平,并使用变分推断计划传播不确定性。这允许捕获非线性相关性之间的过度拟合的风险比现有的方法利用组成结构,这反过来是由结构假设和约束的负担较低。我们表明,所提出的方法在量化和传播多保真度设置的不确定性,这反过来又提高了他们的决策管道的有效性作出了重大改进。

英文摘要:

Multi-fidelity methods are prominently used when cheaply-obtained, but possibly biased and noisy, observations must be effectively combined with limited or expensive true data in order to construct reliable models. This arises in both fundamental machine learning procedures such as Bayesian optimization, as well as more practical science and engineering applications. In this paper we develop a novel multi-fidelity model which treats layers of a deep Gaussian process as fidelity levels, and uses a variational inference scheme to propagate uncertainty across them. This allows for capturing nonlinear correlations between fidelities with lower risk of overfitting than existing methods exploiting compositional structure, which are conversely burdened by structural assumptions and constraints. We show that the proposed approach makes substantial improvements in quantifying and propagating uncertainty in multi-fidelity set-ups, which in turn improves their effectiveness in decision making pipelines.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑