Deep neural networks (DNNs) are widely used as surrogate models in geophysical applications; incorporating theoretical guidance into DNNs has improved the generalizability. However, most of such approaches define the loss function based on the strong form of conservation laws (via partial differential equations, PDEs), which is subject to deteriorated accuracy when the PDE has high order derivatives or the solution has strong discontinuities. Herein, we propose a weak form theory-guided neural network (TgNN-wf), which incorporates the weak form formulation of the PDE into the loss function combined with data constraint and initial and boundary conditions regularizations to tackle the aforementioned difficulties. In the weak form, high order derivatives in the PDE can be transferred to the test functions by performing integration-by-parts, which reduces computational error. We use domain decomposition with locally defined test functions, which captures local discontinuity effectively. Two numerical cases demonstrate the superiority of the proposed TgNN-wf over the strong form TgNN, including the hydraulic head prediction for unsteady-state 2D single-phase flow problems and the saturation profile prediction for 1D two-phase flow problems. Results show that TgNN-wf consistently has higher accuracy than TgNN, especially when strong discontinuity in the solution is present. TgNN-wf also trains faster than TgNN when the number of integration subdomains is not too large (<10,000). Moreover, TgNN-wf is more robust to noises. Thus, the proposed TgNN-wf paves the way for which a variety of deep learning problems in the small data regime can be solved more accurately and efficiently.
Efficient Uncertainty Quantification for Dynamic Subsurface Flow with Surrogate by Theory-guided Neural Network
College of Engineering, Peking University(北京大学工学院);School of Environmental Science and Engineering, Southern University of Science and Technology(南方科技大学环境科学与工程学院);Peng Cheng Laboratory(鹏城实验室)
Deep Learning of Subsurface Flow via Theory-guided Neural Network
College of Engineering, Peking University(北京大学工学院);School of Environmental Science and Engineering, Southern University of Science and Technology(南方科技大学环境科学与工程学院)
Uncertainty quantification of two-phase flow in porous media via coupled-TgNN surrogate model
China University of Petroleum (East China)(中国石油大学(华东));Southern University of Science and Technology(南方科技大学);Peng Cheng Laboratory(鹏城实验室);Peking University(北京大学)
Uncertainty quantification and inverse modeling for subsurface flow in 3D heterogeneous formations using a theory-guided convolutional encoder-decoder network
Peng Cheng Laboratory(鹏城实验室);Southern University of Science and Technology(南方科技大学);Peking University(北京大学)
SURGIN: SURrogate-guided Generative INversion for subsurface multiphase flow with quantified uncertainty
Department of Geotechnical Engineering, College of Civil Engineering, Tongji University(同济大学土木工程学院地质工程系);Key Laboratory of Geotechnical and Underground Engineering of Ministry of Education, Tongji University(教育部同济大学地质与地下工程重点实验室);Physical Science and Engineering Division, King Abdullah University of Science and Technology (KAUST)(卡布斯科学与技术大学(KAUST)物理科学与工程系);State Key Laboratory of Marine Geology, Tongji University(同济大学海洋地质国家重点实验室);Tencent SSV(腾讯SSV);Tencent SD(腾讯SD)
Physically Guided Deep Unsupervised Inversion for 1D Magnetotelluric Models
Universidad Industrial de Santander(桑坦德工业大学);King Fahd University of Petroleum and Minerals(法赫德国王石油与矿产大学);College of Petroleum Engineering and Geosciences(石油工程与地球科学学院)
Theory-guided hard constraint projection (HCP): a knowledge-based data-driven scientific machine learning method
Peng Cheng Laboratory(鹏城实验室);The University of Tokyo(东京大学);Southern University of Science and Technology(南方科技大学);Peking University(北京大学);Malardalen University(马拉达伦大学);LocationMind Inc.(LocationMind公司)
Seismic inversion using hybrid quantum neural networks
Stanford University(斯坦福大学);Indian Institute of Technology (Indian School of Mines) Dhanbad(印度理工学院(印度矿业学院)丹巴德分校);The University of Texas at Austin(德克萨斯大学奥斯汀分校)