arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2402.01484cs.LGstat.COstat.ML

连接点:模式连通性是否是贝叶斯神经网络中可行样本推断的关键?

Connecting the Dots: Is Mode-Connectedness the Key to Feasible Sample-Based Inference in Bayesian Neural Networks?

LMU Munich(慕尼黑大学);Munich Center for Machine Learning(慕尼黑机器学习中心);The University of Manchester(曼彻斯特大学)

Emanuel Sommer, Lisa Wimmer, Theodore Papamarkou, Ludwig Bothmann, Bernd Bischl, David Rügamer

AI总结:

本研究探讨贝叶斯神经网络中基于样本推断的可行性,通过连接权重与函数空间的关系,提出深度集成初始化方法,并建立采样与收敛诊断的实用指南。

摘要:

基于样本的推断(SBI)在贝叶斯神经网络中的一个主要挑战是网络参数空间的大小和结构。我们的工作表明,通过利用权重空间与函数空间之间的特征关系,可以成功进行SBI,并揭示了过参数化与采样问题难度之间的系统性联系。通过大量实验,我们为采样和收敛诊断建立了实用指南。因此,我们提出了一种深度集成初始化方法,作为具有竞争性性能和不确定性量化的有效解决方案。

英文摘要:

A major challenge in sample-based inference (SBI) for Bayesian neural networks is the size and structure of the networks' parameter space. Our work shows that successful SBI is possible by embracing the characteristic relationship between weight and function space, uncovering a systematic link between overparameterization and the difficulty of the sampling problem. Through extensive experiments, we establish practical guidelines for sampling and convergence diagnosis. As a result, we present a deep ensemble initialized approach as an effective solution with competitive performance and uncertainty quantification.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑