arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2311.09491stat.MLcs.LG
收藏

空间贝叶斯神经网络

Spatial Bayesian Neural Networks

University of Wollongong(卧龙岗大学);Huawei Technologies(华为技术有限公司);King Abdullah University of Science and Technology(阿卜杜拉国王科技大学)

Andrew Zammit-Mangion, Michael D. Kaminski, Ba-Hien Tran, Maurizio Filippone, Noel Cressie

AI总结:

本文提出空间贝叶斯神经网络(SBNN),通过空间嵌入层和空间变化参数匹配目标过程的有限维分布,以更灵活地建模多种空间过程。

摘要:

可解释且被充分理解的模型尽管经常被采用,但正如通过先验和后验预测检查所揭示的那样,它们可能难以刻画所关注潜在过程中的空间异质性。在这里,我们提出一类新的、灵活的空间过程模型,称之为空间贝叶斯神经网络(SBNN)。SBNN利用贝叶斯神经网络的表示能力;它通过在网络中加入空间“嵌入层”,并可能加入空间变化的网络参数,来针对空间场景进行定制。SBNN的校准方式是:将其在空间精细网格位置上的有限维分布与所关注目标过程的有限维分布相匹配。该目标过程可能易于模拟,或者我们可能拥有它的许多实现。我们提出了SBNN的若干变体,其中大多数能够比复杂度相近的传统BNN更好地匹配目标过程在所选网格上的有限维分布。我们还表明,SBNN可用于表示实践中常用的多种空间过程,例如Gaussian过程、对数正态过程和最大稳定过程。我们简要讨论了可用于对SBNN进行推断的工具,并在最后讨论了它们的优势和局限性。

英文摘要:

interpretable, and well understood models that are routinely employed even though, as is revealed through prior and posterior predictive checks, these can poorly characterise the spatial heterogeneity in the underlying process of interest. Here, we propose a new, flexible class of spatial-process models, which we refer to as spatial Bayesian neural networks (SBNNs). An SBNN leverages the representational capacity of a Bayesian neural network; it is tailored to a spatial setting by incorporating a spatial ``embedding layer'' into the network and, possibly, spatially-varying network parameters. An SBNN is calibrated by matching its finite-dimensional distribution at locations on a fine gridding of space to that of a target process of interest. That process could be easy to simulate from or we may have many realisations from it. We propose several variants of SBNNs, most of which are able to match the finite-dimensional distribution of the target process at the selected grid better than conventional BNNs of similar complexity. We also show that an SBNN can be used to represent a variety of spatial processes often used in practice, such as Gaussian processes, lognormal processes, and max-stable processes. We briefly discuss the tools that could be used to make inference with SBNNs, and we conclude with a discussion of their advantages and limitations.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑