Local error quantification for Neural Network Differential Equation solvers
John A. Paulson School of Engineering and Applied Sciences, Harvard University(哈佛大学约翰·A·保尔森工程与应用科学学院);University of California, Santa Barbara(加州大学圣巴巴拉分校)
Akshunna S. Dogra, William T Redman
备注:
6 pages, 3 figures, 2 Tables, 1 appendix with a new proposed algorithm. Modifications in the statement and proof of Equation 7 compared to the previous version. Text overlap with arXiv:2004.11826
Neural networks have been identified as powerful tools for the study of complex systems. A noteworthy example is the neural network differential equation (NN DE) solver, which can provide functional approximations to the solutions of a wide variety of differential equations. Such solvers produce robust functional expressions, are well suited for further manipulations on the quantities of interest (for example, taking derivatives), and capable of leveraging the modern advances in parallelization and computing power. However, there is a lack of work on the role precise error quantification can play in their predictions: usually, the focus is on ambiguous and/or global measures of performance like the loss function and/or obtaining global bounds on the errors associated with the predictions. Precise, local error quantification is seldom possible without external means or outright knowledge of the true solution. We address these concerns in the context of dynamical system NN DE solvers, leveraging learnt information within the NN DE solvers to develop methods that allow them to be more accurate and efficient, while still pursuing an unsupervised approach that does not rely on external tools or data. We achieve this via methods that can precisely estimate NN DE solver prediction errors point-wise, thus allowing the user the capacity for efficient and targeted error correction. We exemplify the utility of our methods by testing them on a nonlinear and a chaotic system each.
NewPINNs: Physics-Informing Neural Networks Using Conventional Solvers for Partial Differential Equations
Department of Mathematics, University of California Riverside(加州大学河滨分校数学系);Department of Mechanical Engineering, University of California Riverside(加州大学河滨分校机械工程系);German Innovation Center, Procter & Gamble Service GmbH(普罗cter与 gamble 服务德国创新中心)
Large-scale Neural Solvers for Partial Differential Equations
Helmholtz-Zentrum Dresden-Rossendorf(德累斯顿-罗森多夫亥姆霍兹中心);Technische Universität Dresden(德累斯顿工业大学);Center for Advanced Systems Understanding (CASUS)(高级系统理解中心)
Diffusion-Based Stochastic Operator Networks for Uncertainty Quantification in Stochastic Partial Differential Equations
Department of Mathematics, Florida State University(佛罗里达州立大学数学系);Computer Science and Mathematics Division, Oak Ridge National Laboratory(橡树岭国家实验室计算机科学与数学 division)
Probabilistic operator learning: generative modeling and uncertainty quantification for foundation models of differential equations
Division of Applied Mathematics, Brown University(布朗大学应用数学系);Department of Mathematics, University of California, Riverside(加州大学河滨分校数学系);Department of Mathematics, University of California, Los Angeles(加州大学洛杉矶分校数学系);Department of Mathematics and Statistics, University of Massachusetts Amherst(马萨诸塞大学阿默斯特分校数学与统计学系)
Semi-Implicit Neural Solver for Time-dependent Partial Differential Equations
Technical University Munich(慕尼黑工业大学);École normale supérieure, Paris(巴黎高等师范学院);deepc GmbH, Munich(慕尼黑deepc有限公司);Helmholtz Zentrum München(慕尼黑亥姆霍兹研究中心);University of Zurich(苏黎世大学)
Deep Neural Network Based Differential Equation Solver for HIV Enzyme Kinetics
Memorial Sloan Kettering Cancer Center(纪念斯隆凯特琳癌症中心);Indian Institute of Science Education and Research, Tirupati(印度科学教育与研究学院蒂鲁帕蒂分校);Indian Institute of Technology, Madras(印度理工学院马德拉斯分校)
Opening the Blackbox: Accelerating Neural Differential Equations by Regularizing Internal Solver Heuristics
Indian Institute of Technology Kanpur(印度理工学院坎普尔分校);Julia Computing;Massachusetts Institute of Technology(麻省理工学院);University of Maryland Baltimore(马里兰大学巴尔的摩分校);Pumas AI
Active operator learning with predictive uncertainty quantification for partial differential equations
Sandia National Laboratories(桑迪亚国家实验室);Department of Statistics(统计学系);Data Science, Yale University(数据科学,耶鲁大学);Environmental Engineering, Yale University(环境工程,耶鲁大学);Department of Mathematics(数学系);Department of Mechanical Engineering(机械工程系)
Improved Uncertainty Quantification in Physics-Informed Neural Networks Using Error Bounds and Solution Bundles
Departamento de Ciencia de la Computación, Pontificia Universidad Católica de Chile(计算机科学系,天主教智利大学);Department of Computer Science, University of Tübingen(计算机科学系,图宾根大学);John A. Paulson School of Engineering and Applied Sciences, Harvard University(工程与应用科学学院,哈佛大学)
Institute of AI for Industries, Chinese Academy of Sciences(中国科学院工业人工智能研究所);Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);Northwestern Polytechnical University(西北工业大学)
A Structure-Preserving Framework for Solving Parabolic Partial Differential Equations with Neural Networks
Department of Applied Mathematics, The Hong Kong Polytechnic University(应用数学系,香港Polytechnic大学);Department of Mathematics, University of South Carolina(数学系,南卡罗来纳大学)