Neural networks (NNs) often assign high confidence to their predictions, even for points far out-of-distribution, making uncertainty quantification (UQ) a challenge. When they are employed to model interatomic potentials in materials systems, this problem leads to unphysical structures that disrupt simulations, or to biased statistics and dynamics that do not reflect the true physics. Differentiable UQ techniques can find new informative data and drive active learning loops for robust potentials. However, a variety of UQ techniques, including newly developed ones, exist for atomistic simulations and there are no clear guidelines for which are most effective or suitable for a given case. In this work, we examine multiple UQ schemes for improving the robustness of NN interatomic potentials (NNIPs) through active learning. In particular, we compare incumbent ensemble-based methods against strategies that use single, deterministic NNs: mean-variance estimation, deep evidential regression, and Gaussian mixture models. We explore three datasets ranging from in-domain interpolative learning to more extrapolative out-of-domain generalization challenges: rMD17, ammonia inversion, and bulk silica glass. Performance is measured across multiple metrics relating model error to uncertainty. Our experiments show that none of the methods consistently outperformed each other across the various metrics. Ensembling remained better at generalization and for NNIP robustness; MVE only proved effective for in-domain interpolation, while GMM was better out-of-domain; and evidential regression, despite its promise, was not the preferable alternative in any of the cases. More broadly, cost-effective, single deterministic models cannot yet consistently match or outperform ensembling for uncertainty quantification in NNIPs.
Uncertainty Quantification for AI-Driven Crash Simulation Surrogates: A Comparative Study of Monte Carlo Dropout and Deep Ensemble on Open-Source Bumper Beam Benchmark
Calibrating Ensembles for Scalable Uncertainty Quantification in Deep Learning-based Medical Segmentation
University of Cambridge(剑桥大学);Cancer Research UK Cambridge Centre(英国癌症研究中心剑桥中心);Cancer Research UK Cambridge Institute(英国癌症研究中心剑桥研究所);Danube Private University(多瑙河私立大学);KTH Royal Institute of Technology(KTH皇家理工学院)
Uncertainty quantification in fine-tuned LLMs using LoRA ensembles
Stockholm University Department of Physics(斯德哥尔摩大学物理系);Department of Mathematical Sciences(数学科学系);Chalmers university of technology & University of Gothenburg(楚德勒斯技术大学及哥德堡大学);VERSES Research Lab(VERSES研究实验室)
Ensemble learning and iterative training (ELIT) machine learning: applications towards uncertainty quantification and automated experiment in atom-resolved microscopy
Uncertainty Quantification in PINNs for Turbulent Flows: Bayesian Inference and Repulsive Ensembles
Division of Applied Mathematics, Brown University(布朗大学应用数学系);Department of Computing and Mathematical Sciences, California Institute of Technology(加州理工学院计算与数学科学系);Department of Mechanical Engineering, Massachusetts Institute of Technology(麻省理工学院机械工程系)
本文提出了一种概率扩展的PINN框架,结合贝叶斯方法、麦克斯韦-玻尔兹曼抽样和斥力深度集合,以提高湍流建模中的不确定性校准,通过Van der Pol振荡器和圆柱绕流测试案例验证了其有效性。
Bayesian optimized deep ensemble for uncertainty quantification of deep neural networks: a system safety case study on sodium fast reactor thermal stratification modeling
Texas A&M University(德克萨斯农工大学);Argonne National Laboratory(阿贡国家实验室);Oak Ridge National Laboratory(橡树岭国家实验室)
Accurate and Efficient Hybrid-Ensemble Atmospheric Data Assimilation in Latent Space with Uncertainty Quantification
Department of Earth and Environmental Engineering, School of Engineering and Applied Sciences, Climate School, Columbia University(地球与环境工程系,工程与应用科学学院,气候学院,哥伦比亚大学);Learning the Earth with Artificial Intelligence and Physics (LEAP) Center, Columbia University(人工智能与物理学习地球中心,哥伦比亚大学);Shanghai Artificial Intelligence Laboratory, Shanghai, China(上海人工智能实验室,上海,中国);The Chinese University of Hong Kong, Hong Kong, China(香港中文大学,香港,中国);Department of Computer Science and Technology, Tsinghua University, Beijing, China(计算机科学与技术系,清华大学,北京,中国)
Bayesian Uncertainty Quantification with Anchored Ensembles for Robust EV Power Consumption Prediction
Connected & Automated Vehicles, National Research Council Canada(连接与自动化车辆,加拿大国家研究委员会);National Research Council Canada(加拿大国家研究委员会);Transportation Emissions & Electrification Laboratory(交通运输排放与电动化实验室);Environment and Climate Change Canada(加拿大环境与气候变化部)
AdaptNTK: Adaptive Uncertainty Quantification and Active Learning for Neural Network Potentials
Center for Applied Mathematics, Cornell University(康奈尔大学应用数学中心);R. F. Smith School of Chemical and Biomolecular Engineering, Cornell University(康奈尔大学R.F.史密斯化学与生物分子工程学院)
On the Predictive Skill of Artificial Intelligence-based Weather Models for Extreme Events using Uncertainty Quantification
Applied Machine Learning Group(应用机器学习组);Fraunhofer Heinrich-Hertz Institute(弗劳恩霍夫海因里希-赫兹研究所);Signal Theory and Communications Dept.(信号理论与通信系);Universidad Carlos III de Madrid (UC3M)(马德里卡洛斯三世大学)
Evaluation of Machine Learning Techniques for Forecast Uncertainty Quantification
Servicio Meteorológico Nacional(国家气象局);Universidad de Buenos Aires(布宜诺斯艾利斯大学);CONICET(国家科学技术研究委员会);Centro de Investigaciones del Mar y la Atmósfera(海洋与大气研究中心);Instituto Franco-Argentino para el Estudio del Clima y sus Impactos(法阿气候及其影响研究所);Universidad Nacional del Nordeste(东北国立大学);IMT Atlantique(大西洋国立高等矿业电信学校);CNRS(法国国家科学研究中心);IRD(法国可持续发展研究所)
QDeepGR4J: Quantile-based ensemble of deep learning and GR4J hybrid rainfall-runoff models for extreme flow prediction with uncertainty quantification
School of Mathematics and Statistics, University of New South Wales, Sydney, NSW 2052, Australia(数学与统计学学院,新南威尔士大学,悉尼,新南威尔士州,2052,澳大利亚);Data Analytics for Resources and Environments, Australian Research Council—Industrial Transformation Training Centre, Sydney, NSW, Australia(资源与环境数据分析,澳大利亚研究理事会—工业转型培训中心,悉尼,新南威尔士州,澳大利亚)
A Staged Approach using Machine Learning and Uncertainty Quantification to Predict the Risk of Hip Fracture
Michigan Technological University(密歇根理工大学);UC Davis Health(加州大学戴维斯分校医学中心);Kennesaw State University(肯尼索州立大学);Tulane University(杜兰大学);University of California, Irvine(加州大学尔湾分校)