This work considers stochastic Galerkin approximations of linear elliptic partial differential equations (PDEs) with stochastic forcing terms and stochastic diffusion coefficients, that cannot be bounded uniformly away from zero and infinity. A traditional numerical method for solving the resulting high-dimensional coupled system of PDEs is replaced by deep learning techniques. In order to achieve this, physics-informed neural networks (PINNs), which typically operate on the strong residual of the PDE and can therefore be applied in a wide range of settings, are considered. As a second approach, the Deep Ritz method, which is a neural network that minimizes the Ritz energy functional to find the weak solution, is employed. While the second approach only works in special cases, it overcomes the necessity of testing in variational problems while maintaining mathematical rigor and ensuring the existence of a unique solution. Furthermore, the residual is of a lower differentiation order, reducing the training cost considerably. The efficiency of the method is demonstrated on several model problems.
In this paper, we propose a Galerkin finite element method for the elliptic optimal control problem governed by the Riesz space-fractional PDEs on 2D domains with control variable being discretized by variational discretization technique. The optimality condition is derived and priori error estimates of control, costate and state variables are successfully established. Numerical test is carried out to illustrate the accuracy performance of this approach.
In this paper, we study the stabilizer-free weak Galerkin methods on polytopal meshes for a class of second order elliptic boundary value problems of divergence form and with gradient nonlinearity in the principal coefficient. With certain assumptions on the nonlinear coefficient, we show that the discrete problem has a unique solution. This is achieved by showing that the associated operator satisfies certain continuity and monotonicity properties. With the help of these properties, we derive optimal error estimates in the energy norm. We present several numerical examples to verify the error…
In this paper, we develop a new discontinuous Galerkin method for solving several types of partial differential equations (PDEs) with high order spatial derivatives. We combine the advantages of local discontinuous Galerkin (LDG) method and ultra-weak discontinuous Galerkin (UWDG) method. Firstly, we rewrite the PDEs with high order spatial derivatives into a lower order system, then apply the UWDG method to the system. We first consider the fourth order and fifth order nonlinear PDEs in one space dimension, and then extend our method to general high order problems and two space dimensions. Th…
In this paper, we propose a fast spectral-Galerkin method for solving PDEs involving integral fractional Laplacian in $\mathbb{R}^d$, which is built upon two essential components: (i) the Dunford-Taylor formulation of the fractional Laplacian; and (ii) Fourier-like bi-orthogonal mapped Chebyshev functions (MCFs) as basis functions. As a result, the fractional Laplacian can be fully diagonalised, and the complexity of solving an elliptic fractional PDE is quasi-optimal, i.e., $O((N\log_2N)^d)$ with $N$ being the number of modes in each spatial direction. Ample numerical tests for various decayi…
The quantification of multivariate uncertainties in partial differential equations can easily exceed any computing capacity unless proper measures are taken to reduce the complexity of the model. In this work, we propose a multidimensional Galerkin Proper Orthogonal Decomposition that optimally reduces each dimension of a tensorized product space. We provide the analytical framework and results that define and quantify the low-dimensional approximation. We illustrate its application for uncertainty modeling with Polynomial Chaos Expansions and show its efficiency in a numerical example.
We consider a linear elliptic partial differential equation (PDE) with a generic uniformly bounded parametric coefficient. The solution to this PDE problem is approximated in the framework of stochastic Galerkin finite element methods. We perform a posteriori error analysis of Galerkin approximations and derive a reliable and efficient estimate for the energy error in these approximations. Practical versions of this error estimate are discussed and tested numerically for a model problem with non-affine parametric representation of the coefficient. Furthermore, we use the error reduction indica…
While deep learning has achieved remarkable success in solving partial differential equations (PDEs), it still faces significant challenges, particularly when the PDE solutions have low regularity or singularities. To address these issues, we propose the Weak TransNet (WTN) method, based on a Petrov-Galerkin formulation, for solving elliptic PDEs in this work, though its framework may extend to other classes of equations. Specifically, the neural feature space defined by TransNet (Zhang et al., 2023) is used as the trial space, while the test space is composed of radial basis functions. Since …
In this paper, we perform the convergence analysis of unsupervised Legendre--Galerkin neural networks (ULGNet), a deep-learning-based numerical method for solving partial differential equations (PDEs). Unlike existing deep learning-based numerical methods for PDEs, the ULGNet expresses the solution as a spectral expansion with respect to the Legendre basis and predicts the coefficients with deep neural networks by solving a variational residual minimization problem. Since the corresponding loss function is equivalent to the residual induced by the linear algebraic system depending on the choic…
We propose a least squares Galerkin based gradient recovery to approximate Dirichlet problems for strong solutions of linear elliptic problems in nondivergence form and corresponding apriori and aposteriori error bounds. This approach is used to tackle fully nonlinear elliptic problems, e.g., Monge-Ampère, Hamilton-Jacobi-Bellman, using the smooth (vanilla) and the semismooth Newton linearization. We discuss numerical results, including adaptive methods based on the aposteriori error indicators.
This article considers the extension of two-grid $hp$-version discontinuous Galerkin finite element methods for the numerical approximation of second-order quasilinear elliptic boundary value problems of monotone type to the case when agglomerated polygonal/polyhedral meshes are employed for the coarse mesh approximation. We recall that within the two-grid setting, while it is necessary to solve a nonlinear problem on the coarse approximation space, only a linear problem must be computed on the original fine finite element space. In this article, the coarse space will be constructed by agglome…
This paper aims at studying the difference between Ritz-Galerkin (R-G) method and deep neural network (DNN) method in solving partial differential equations (PDEs) to better understand deep learning. To this end, we consider solving a particular Poisson problem, where the information of the right-hand side of the equation f is only available at n sample points, that is, f is known at finite sample points. Through both theoretical and numerical studies, we show that solution of the R-G method converges to a piecewise linear function for the one dimensional (1D) problem or functions of lower reg…
Wavelet Galerkin method for fractional elliptic differential equations
School of Mathematics and Statistics, Gansu Key Laboratory of Applied Mathematics and Complex Systems, Lanzhou University（兰州大学数学与统计学院，甘肃省应用数学与复杂系统重点实验室）
A Discontinuous Galerkin Method for H(curl)-Elliptic Hemivariational Inequalities
School of Mathematics and Statistics, Xi’an Jiaotong University（西安交通大学数学与统计学院）；School of Mathematical Sciences, Shanghai Jiao Tong University（上海交通大学数学科学学院）；Shanghai Artificial Intelligence Laboratory（上海人工智能实验室）；Department of Mathematics, University of Iowa（爱荷华大学数学系）；School of Mathematical Sciences, Inner Mongolia University（内蒙古大学数学科学学院）
We consider the time discretization of a linear parabolic problem by the discontinuous Galerkin (DG) method using piecewise polynomials of degree at most $r-1$ in $t$, for $r\ge1$ and with maximum step size~$k$. It is well known that the spatial $L_2$-norm of the DG error is of optimal order $k^r$ globally in time, and is, for $r\ge2$, superconvergent of order $k^{2r-1}$ at the nodes. We show that on the $n$th subinterval $(t_{n-1},t_n)$, the dominant term in the DG error is proportional to the local right Radau polynomial of degree $r$. This error profile implies that the DG error is of order…
A parallelizable iterative procedure based on domain decomposition is presented and analyzed for weak Galerkin finite element methods for second order elliptic equations. The convergence analysis is established for the decomposition of the domain into individual elements associated to the weak Galerkin methods or into larger subdomains. A series of numerical tests are illustrated to verify the theory developed in this paper.
Discontinuous Galerkin finite element operator network for solving non-smooth PDEs
Department of Mathematics, Florida State University（数学系，佛罗里达州立大学）；Department of Mathematical Sciences, Seoul National University（数学科学系，首尔国立大学）；Department of AI, Chung-Ang University（人工智能系， Chung-Ang 大学）
The aim of this paper is to apply a high-order discontinuous-in-time scheme to second-order hyperbolic partial differential equations (PDEs). We first discretize the PDEs in time while keeping the spatial differential operators undiscretized. The well-posedness of this semi-discrete scheme is analyzed and a priori error estimates are derived in the energy norm. We then combine this $hp$-version discontinuous Galerkin method for temporal discretization with an $H^1$-conforming finite element approximation for the spatial variables to construct a fully discrete scheme. A prior error estimates ar…
We propose a least-squares method involving the recovery of the gradient and possibly the Hessian for elliptic equation in nondivergence form. As our approach is based on the Lax--Milgram theorem with the curl-free constraint built into the target (or cost) functional, the discrete spaces require no inf-sup stabilization. We show that standard conforming finite elements can be used yielding apriori and aposteriori convergnece results. We illustrate our findings with numerical experiments with uniform or adaptive mesh refinement.
In this paper, we design and analysis a modified weak Galerkin (MWG) finite element method for $\boldsymbol{H}(\mathrm{curl})-$elliptic problem. We first introduce a new discrete weak curl operator and the MWG finite element space. The modified weak Galerkin method does not require the penalty parameter by comparing with traditional DG methods. We prove optimal error estimates in energy norm. At last, we provide the numerical results to confirm these theoretical results.
Fully implicit Runge-Kutta (IRK) methods have many desirable properties as time integration schemes in terms of accuracy and stability, but high-order IRK methods are not commonly used in practice with numerical PDEs due to the difficulty of solving the stage equations. This paper introduces a theoretical and algorithmic preconditioning framework for solving the systems of equations that arise from IRK methods applied to linear numerical PDEs (without algebraic constraints). This framework also naturally applies to discontinuous Galerkin discretizations in time. Under quite general assumptions…
In this paper we present new stability and optimal error analyses of hybridized discontinuous Galerkin (HDG) methods which do not require elliptic regularity assumptions. To obtain error estimates without elliptic regularity assumptions, we use new inf-sup conditions based on stabilized saddle point structures of HDG methods. We show that this approach can be applied to obtain optimal error estimates of HDG methods for the Poisson equations, the convection-reaction-diffusion equations, the Stokes equations, and the Oseen equations.
A discontinuous Galerkin (DG) scheme for solving semilinear elliptic problem is developed and analyzed in this paper. The DG finite element discretizations are established, and the corresponding existence and uniqueness theorem is proved by using Brouwer's fixed point method. Some optimal priori error estimates under both DG norm and $L^2$ norm are presented. Numerical results are also shown to confirm the efficiency of the proposed approach.
In this paper, we study the convergence of adaptive mixed interior penalty discontinuous Galerkin method for H(curl)-elliptic problems. We first get the mixed model of H(curl)-elliptic problem by introducing a new intermediate variable. Then we discuss the continuous variational problem and discrete variational problem, which based on interior penalty discontinuous Galerkin approximation. Next, we construct the corresponding posteriori error indicator, and prove the contraction of the summation of the energy error and the scaled error indicator. At last, we confirm and illustrate the theoretic…
In this paper, we design the first residual type a posteriori error estimator for mixed interior penalty discontinuous Galerkin method for the H(curl)-elliptic problems. Then we prove that our residual based a posteriori error indicator is both reliable and efficient. At last, we present some numerical experiments to validate the performance of the indicator within an adaptive mesh refinement procedure.
Fully implicit Runge-Kutta (IRK) methods have many desirable accuracy and stability properties as time integration schemes, but high-order IRK methods are not commonly used in practice with large-scale numerical PDEs because of the difficulty of solving the stage equations. This paper introduces a theoretical and algorithmic framework for solving the nonlinear equations that arise from IRK methods (and discontinuous Galerkin discretizations in time) applied to nonlinear numerical PDEs, including PDEs with algebraic constraints. Several new linearizations of the nonlinear IRK equations are deve…
A new primal-dual weak Galerkin (PDWG) finite element method is introduced and analyzed for the ill-posed elliptic Cauchy problems with ultra-low regularity assumptions on the exact solution. The Euler-Lagrange formulation resulting from the PDWG scheme yields a system of equations involving both the primal equation and the adjoint (dual) equation. The optimal order error estimate for the primal variable in a low regularity assumption is established. A series of numerical experiments are illustrated to validate effectiveness of the developed theory.
In this paper, we present a unified analysis of the superconvergence property for a large class of mixed discontinuous Galerkin methods. This analysis applies to both the Poisson equation and linear elasticity problems with symmetric stress formulations. Based on this result, some locally postprocess schemes are employed to improve the accuracy of displacement by order min(k+1, 2) if polynomials of degree k are employed for displacement. Some numerical experiments are carried out to validate the theoretical results.
A balancing domain decomposition by constraints preconditioner for a hybridizable discontinuous Galerkin discretization of an elliptic optimal control problem
We propose a discontinuous Galerkin(DG) method to approximate the elliptic interface problem on unfitted mesh using a new approximation space. The approximation space is constructed by patch reconstruction with one degree of freedom per element. The optimal error estimates in both L2 norm and DG energy norm are obtained, without the typical constraints for DG method on how the interface intersects to the elements in the mesh. Other than enjoying the advantages of DG method, our method may achieve even better efficiency than the conforming finite element method, as illustrated by numerical exam…
