The hybrid neural differentiable models mark a significant advancement in the field of scientific machine learning. These models, integrating numerical representations of known physics into deep neural networks, offer enhanced predictive capabilities and show great potential for data-driven modeling of complex physical systems. However, a critical and yet unaddressed challenge lies in the quantification of inherent uncertainties stemming from multiple sources. Addressing this gap, we introduce a novel method, DiffHybrid-UQ, for effective and efficient uncertainty propagation and estimation in hybrid neural differentiable models, leveraging the strengths of deep ensemble Bayesian learning and nonlinear transformations. Specifically, our approach effectively discerns and quantifies both aleatoric uncertainties, arising from data noise, and epistemic uncertainties, resulting from model-form discrepancies and data sparsity. This is achieved within a Bayesian model averaging framework, where aleatoric uncertainties are modeled through hybrid neural models. The unscented transformation plays a pivotal role in enabling the flow of these uncertainties through the nonlinear functions within the hybrid model. In contrast, epistemic uncertainties are estimated using an ensemble of stochastic gradient descent (SGD) trajectories. This approach offers a practical approximation to the posterior distribution of both the network parameters and the physical parameters. Notably, the DiffHybrid-UQ framework is designed for simplicity in implementation and high scalability, making it suitable for parallel computing environments. The merits of the proposed method have been demonstrated through problems governed by both ordinary and partial differentiable equations.
Improving Robustness against Real-World and Worst-Case Distribution Shifts through Decision Region Quantification
University of Erlangen-Nürnberg(埃尔朗根-纽伦堡大学);Mila - Quebec AI Institute(米拉-魁北克人工智能研究所);Hausdorff Center for Mathematics, University of Bonn(波恩大学豪斯多夫数学中心);McGill University(麦吉尔大学);Google Deepmind(谷歌DeepMind)
Vine Copulas as Differentiable Computational Graphs
National University of Singapore(新加坡国立大学);University of Applied Sciences Western Switzerland (HES-SO)(瑞士西部应用科学与艺术大学);LMU Munich(慕尼黑大学);Munich Center for Machine Learning(慕尼黑机器学习中心)
Fault Diagnosis and Quantification for Photovoltaic Arrays based on Differentiable Physical Models
College of Mechanical and Electrical Engineering, Hohai University(河海大学机械与电子工程学院);Concordia Institute for Information Systems Engineering, Concordia University(康科德大学信息系统工程研究所);AAU Energy, Aalborg University(奥胡斯大学能源研究所)
Surrogate Modelling of Proton Dose with Monte Carlo Dropout Uncertainty Quantification
Institute for Mathematical Innovation University of Bath, Bath, UK(数学创新研究所 英国巴斯大学);Department of Mathematical Sciences University of Bath, Bath, UK(数学科学系 英国巴斯大学)
DiffRenderGAN: Addressing Training Data Scarcity in Deep Segmentation Networks for Quantitative Nanomaterial Analysis through Differentiable Rendering and Generative Modelling
Department Artificial Intelligence in Biomedical Engineering(人工智能生物医学工程部门);Friedrich-Alexander-University Erlangen-Nürnberg(埃朗根-纽伦堡弗里德里希-亚历山大大学);Pattern Recognition Lab(模式识别实验室);Institute for Nanotechnology and Correlative Microscopy(纳米技术与相关显微镜研究所);Lucid Concepts AG(Lucid Concepts公司);Fraunhofer Institute for Ceramic Technologies and Systems(弗劳恩霍夫陶瓷技术与系统研究所);Freie Universität Berlin(柏林自由大学);Max Planck Institute for the Science of Light(马克斯·普朗克光科学研究所);Julius-Maximilians-University Würzburg(乌尔姆-马克斯·普朗克大学)
SURGIN: SURrogate-guided Generative INversion for subsurface multiphase flow with quantified uncertainty
Department of Geotechnical Engineering, College of Civil Engineering, Tongji University(同济大学土木工程学院地质工程系);Key Laboratory of Geotechnical and Underground Engineering of Ministry of Education, Tongji University(教育部同济大学地质与地下工程重点实验室);Physical Science and Engineering Division, King Abdullah University of Science and Technology (KAUST)(卡布斯科学与技术大学(KAUST)物理科学与工程系);State Key Laboratory of Marine Geology, Tongji University(同济大学海洋地质国家重点实验室);Tencent SSV(腾讯SSV);Tencent SD(腾讯SD)
Variational Quantum Physics-Informed Neural Networks for Hydrological PDE-Constrained Learning with Inherent Uncertainty Quantification
Faculty of Computer Science and Multimedia, Lincoln University College, Petaling Jaya, Selangor, Malaysia(计算机科学与多媒体学院,林肯大学学院,Petaling Jaya,Selangor,马来西亚)
Anisotropic Permeability Tensor Prediction from Porous Media Microstructure via Physics-Informed Progressive Transfer Learning with Hybrid CNN-Transformer
Faculty of Mathematics and Natural Sciences, University of Oslo(奥斯陆大学数学与自然科学学院)
Multiparameter Uncertainty Mapping in Quantitative Molecular MRI using a Physics-Structured Variational Autoencoder (PS-VAE)
School of Biomedical Engineering, Tel-Aviv University(生物医学工程学院,特拉维夫大学);School of Biochemistry, Neurobiology, and Biophysics, Tel-Aviv University(生物化学、神经生物学与生物物理学学院,特拉维夫大学);Institute of Neuroradiology, University Hospital Erlangen(神经放射学研究所,埃朗根大学医院);Department of Artificial Intelligence in Biomedical Engineering, Friedrich-Alexander Universität Erlangen-Nürnberg (FAU)(生物医学工程人工智能系,弗赖堡-艾尔朗根-纽伦堡大学(FAU));Sagol School of Neuroscience, Tel-Aviv University(萨戈尔神经科学学院,特拉维夫大学)