arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2501.00952cond-mat.dis-nncond-mat.mtrl-sciphysics.data-an
收藏

基于部分贝叶斯神经网络的材料与化学主动学习与迁移学习

Active and transfer learning with partially Bayesian neural networks for materials and chemicals

Sarah I. Allec, Maxim Ziatdinov

AI总结:

本文提出部分贝叶斯神经网络(PBNNs),在较低计算成本下实现与完全贝叶斯网络相当的准确性与不确定性估计,并通过预训练权重初始化先验分布加速实验数据主动学习,为有限复杂数据集提供实用工具。

摘要:

主动学习是一种为探索选择最具信息量数据点的迭代过程,对高效表征材料和化学性质空间至关重要。神经网络擅长预测这些性质,但缺乏主动学习驱动探索所需的不确定性量化。完全贝叶斯神经网络将权重视为通过高级 Markov Chain Monte Carlo 方法推断的概率分布,能提供稳健的不确定性量化,但计算成本高昂。在此,我们证明部分贝叶斯神经网络(PBNNs)——仅选定层具有概率权重而其他层保持确定性——能在较低计算成本下,在主动学习任务中实现与完全贝叶斯网络相当的准确性和不确定性估计。此外,通过用理论计算预训练的权重初始化先验分布,我们证明 PBNNs 能有效利用计算预测来加速实验数据的主动学习。我们在分子性质预测和材料科学任务上验证了这些方法,确立了 PBNNs 作为处理有限、复杂数据集主动学习的实用工具。

英文摘要:

Active learning, an iterative process of selecting the most informative data points for exploration, is crucial for efficient characterization of materials and chemicals property space. Neural networks excel at predicting these properties but lack the uncertainty quantification needed for active learning-driven exploration. Fully Bayesian neural networks, in which weights are treated as probability distributions inferred via advanced Markov Chain Monte Carlo methods, offer robust uncertainty quantification but at high computational cost. Here, we show that partially Bayesian neural networks (PBNNs), where only selected layers have probabilistic weights while others remain deterministic, can achieve accuracy and uncertainty estimates on active learning tasks comparable to fully Bayesian networks at lower computational cost. Furthermore, by initializing prior distributions with weights pre-trained on theoretical calculations, we demonstrate that PBNNs can effectively leverage computational predictions to accelerate active learning of experimental data. We validate these approaches on both molecular property prediction and materials science tasks, establishing PBNNs as a practical tool for active learning with limited, complex datasets.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑