In this paper, we develop a new discontinuous Galerkin method for solving several types of partial differential equations (PDEs) with high order spatial derivatives. We combine the advantages of local discontinuous Galerkin (LDG) method and ultra-weak discontinuous Galerkin (UWDG) method. Firstly, we rewrite the PDEs with high order spatial derivatives into a lower order system, then apply the UWDG method to the system. We first consider the fourth order and fifth order nonlinear PDEs in one space dimension, and then extend our method to general high order problems and two space dimensions. The main advantage of our method over the LDG method is that we have introduced fewer auxiliary variables, thereby reducing memory and computational costs. The main advantage of our method over the UWDG method is that no internal penalty terms are necessary in order to ensure stability for both even and odd order PDEs. We prove stability of our method in the general nonlinear case and provide optimal error estimates for linear PDEs for the solution itself as well as for the auxiliary variables approximating its derivatives. A key ingredient in the proof of the error estimates is the construction of the relationship between the derivative and the element interface jump of the numerical solution and the auxiliary variable solution of the solution derivative. With this relationship, we can then use the discrete Sobolev and Poincaré inequalities to obtain the optimal error estimates. The theoretical findings are confirmed by numerical experiments.
We develop and analyze an ultraweak formulation of linear PDEs in nondivergence form where the coefficients satisfy the Cordes condition. Based on the ultraweak formulation we propose discontinuous Petrov--Galerkin (DPG) methods. We investigate Fortin operators for the fully discrete schemes and provide a posteriori estimators for the methods under consideration. Numerical experiments are presented in the case of uniform and adaptive mesh-refinement.
High-order polygonal discontinuous Petrov-Galerkin (PolyDPG) methods using ultraweak formulations
The Institute for Computational Engineering and Sciences (ICES), The University of Texas at Austin（德克萨斯大学奥斯汀分校计算工程与科学研究所）；MSC Software Corporation（MSC软件公司）
In this paper, we propose a Galerkin finite element method for the elliptic optimal control problem governed by the Riesz space-fractional PDEs on 2D domains with control variable being discretized by variational discretization technique. The optimality condition is derived and priori error estimates of control, costate and state variables are successfully established. Numerical test is carried out to illustrate the accuracy performance of this approach.
In this paper, we study the stabilizer-free weak Galerkin methods on polytopal meshes for a class of second order elliptic boundary value problems of divergence form and with gradient nonlinearity in the principal coefficient. With certain assumptions on the nonlinear coefficient, we show that the discrete problem has a unique solution. This is achieved by showing that the associated operator satisfies certain continuity and monotonicity properties. With the help of these properties, we derive optimal error estimates in the energy norm. We present several numerical examples to verify the error…
In this paper, we propose a fast spectral-Galerkin method for solving PDEs involving integral fractional Laplacian in $\mathbb{R}^d$, which is built upon two essential components: (i) the Dunford-Taylor formulation of the fractional Laplacian; and (ii) Fourier-like bi-orthogonal mapped Chebyshev functions (MCFs) as basis functions. As a result, the fractional Laplacian can be fully diagonalised, and the complexity of solving an elliptic fractional PDE is quasi-optimal, i.e., $O((N\log_2N)^d)$ with $N$ being the number of modes in each spatial direction. Ample numerical tests for various decayi…
We consider a linear elliptic partial differential equation (PDE) with a generic uniformly bounded parametric coefficient. The solution to this PDE problem is approximated in the framework of stochastic Galerkin finite element methods. We perform a posteriori error analysis of Galerkin approximations and derive a reliable and efficient estimate for the energy error in these approximations. Practical versions of this error estimate are discussed and tested numerically for a model problem with non-affine parametric representation of the coefficient. Furthermore, we use the error reduction indica…
While deep learning has achieved remarkable success in solving partial differential equations (PDEs), it still faces significant challenges, particularly when the PDE solutions have low regularity or singularities. To address these issues, we propose the Weak TransNet (WTN) method, based on a Petrov-Galerkin formulation, for solving elliptic PDEs in this work, though its framework may extend to other classes of equations. Specifically, the neural feature space defined by TransNet (Zhang et al., 2023) is used as the trial space, while the test space is composed of radial basis functions. Since …
In this work, we propose and develop an arbitrary-order adaptive discontinuous Petrov-Galerkin (DPG) method for the nonlinear Grad-Shafranov equation. An ultraweak formulation of the DPG scheme for the equation is given based on a minimal residual method. The DPG scheme has the advantage of providing more accurate gradients compared to conventional finite element methods, which is desired for numerical solutions to the Grad-Shafranov equation. The numerical scheme is augmented with an adaptive mesh refinement approach, and a criterion based on the residual norm in the minimal residual method i…
The quantification of multivariate uncertainties in partial differential equations can easily exceed any computing capacity unless proper measures are taken to reduce the complexity of the model. In this work, we propose a multidimensional Galerkin Proper Orthogonal Decomposition that optimally reduces each dimension of a tensorized product space. We provide the analytical framework and results that define and quantify the low-dimensional approximation. We illustrate its application for uncertainty modeling with Polynomial Chaos Expansions and show its efficiency in a numerical example.
This article considers the extension of two-grid $hp$-version discontinuous Galerkin finite element methods for the numerical approximation of second-order quasilinear elliptic boundary value problems of monotone type to the case when agglomerated polygonal/polyhedral meshes are employed for the coarse mesh approximation. We recall that within the two-grid setting, while it is necessary to solve a nonlinear problem on the coarse approximation space, only a linear problem must be computed on the original fine finite element space. In this article, the coarse space will be constructed by agglome…
This paper aims at studying the difference between Ritz-Galerkin (R-G) method and deep neural network (DNN) method in solving partial differential equations (PDEs) to better understand deep learning. To this end, we consider solving a particular Poisson problem, where the information of the right-hand side of the equation f is only available at n sample points, that is, f is known at finite sample points. Through both theoretical and numerical studies, we show that solution of the R-G method converges to a piecewise linear function for the one dimensional (1D) problem or functions of lower reg…
In this paper, we perform the convergence analysis of unsupervised Legendre--Galerkin neural networks (ULGNet), a deep-learning-based numerical method for solving partial differential equations (PDEs). Unlike existing deep learning-based numerical methods for PDEs, the ULGNet expresses the solution as a spectral expansion with respect to the Legendre basis and predicts the coefficients with deep neural networks by solving a variational residual minimization problem. Since the corresponding loss function is equivalent to the residual induced by the linear algebraic system depending on the choic…
Wavelet Galerkin method for fractional elliptic differential equations
School of Mathematics and Statistics, Gansu Key Laboratory of Applied Mathematics and Complex Systems, Lanzhou University（兰州大学数学与统计学院，甘肃省应用数学与复杂系统重点实验室）
We consider the time discretization of a linear parabolic problem by the discontinuous Galerkin (DG) method using piecewise polynomials of degree at most $r-1$ in $t$, for $r\ge1$ and with maximum step size~$k$. It is well known that the spatial $L_2$-norm of the DG error is of optimal order $k^r$ globally in time, and is, for $r\ge2$, superconvergent of order $k^{2r-1}$ at the nodes. We show that on the $n$th subinterval $(t_{n-1},t_n)$, the dominant term in the DG error is proportional to the local right Radau polynomial of degree $r$. This error profile implies that the DG error is of order…
On perfectly matched layers for discontinuous Petrov-Galerkin methods
The Institute for Computational Engineering and Sciences (ICES), The University of Texas at Austin（德克萨斯大学奥斯汀分校计算工程与科学研究所）；MSC Software Corporation（MSC软件公司）
The aim of this paper is to apply a high-order discontinuous-in-time scheme to second-order hyperbolic partial differential equations (PDEs). We first discretize the PDEs in time while keeping the spatial differential operators undiscretized. The well-posedness of this semi-discrete scheme is analyzed and a priori error estimates are derived in the energy norm. We then combine this $hp$-version discontinuous Galerkin method for temporal discretization with an $H^1$-conforming finite element approximation for the spatial variables to construct a fully discrete scheme. A prior error estimates ar…
Fully implicit Runge-Kutta (IRK) methods have many desirable properties as time integration schemes in terms of accuracy and stability, but high-order IRK methods are not commonly used in practice with numerical PDEs due to the difficulty of solving the stage equations. This paper introduces a theoretical and algorithmic preconditioning framework for solving the systems of equations that arise from IRK methods applied to linear numerical PDEs (without algebraic constraints). This framework also naturally applies to discontinuous Galerkin discretizations in time. Under quite general assumptions…
We develop and analyze a discontinuous Petrov--Galerkin method with optimal test functions (DPG method) for a shallow shell model of Koiter type. It is based on a uniformly stable ultraweak formulation and thus converges robustly quasi-uniformly. Numerical experiments for various cases, including the Scordelis--Lo cylindrical roof, elliptic and hyperbolic geometries, illustrate its performance. The built-in DPG error estimator gives rise to adaptive mesh refinements that are capable to resolve boundary and interior layers. The membrane locking is dealt with by raising the polynomial degree onl…
Finite element simulations have been used to solve various partial differential equations (PDEs) that model physical, chemical, and biological phenomena. The resulting discretized solutions to PDEs often do not satisfy requisite physical properties, such as positivity or monotonicity. Such invalid solutions pose both modeling challenges, since the physical interpretation of simulation results is not possible, and computational challenges, since such properties may be required to advance the scheme. We, therefore, consider the problem of computing solutions that preserve these structural soluti…
There has been an arising trend of adopting deep learning methods to study partial differential equations (PDEs). This article is to propose a Deep Learning Galerkin Method (DGM) for the closed-loop geothermal system, which is a new coupled multi-physics PDEs and mainly consists of a framework of underground heat exchange pipelines to extract the geothermal heat from the geothermal reservoir. This method is a natural combination of Galerkin Method and machine learning with the solution approximated by a neural network instead of a linear combination of basis functions. We train the neural netw…
Fourier continuation is an approach used to create periodic extensions of non-periodic functions in order to obtain highly-accurate Fourier expansions. These methods have been used in PDE-solvers and have demonstrated high-order convergence and spectrally accurate dispersion relations in numerical experiments. Discontinuous Galerkin (DG) methods are increasingly used for solving PDEs and, as all Galerkin formulations, come with a strong framework for proving stability and convergence. Here we propose the use of Fourier continuation in forming a new basis for the DG framework.
Friedrichs' systems discretized with the Discontinuous Galerkin method: domain decomposable model order reduction and Graph Neural Networks approximating vanishing viscosity solutions
Fully implicit Runge-Kutta (IRK) methods have many desirable accuracy and stability properties as time integration schemes, but high-order IRK methods are not commonly used in practice with large-scale numerical PDEs because of the difficulty of solving the stage equations. This paper introduces a theoretical and algorithmic framework for solving the nonlinear equations that arise from IRK methods (and discontinuous Galerkin discretizations in time) applied to nonlinear numerical PDEs, including PDEs with algebraic constraints. Several new linearizations of the nonlinear IRK equations are deve…
Discontinuous Galerkin finite element operator network for solving non-smooth PDEs
Department of Mathematics, Florida State University（数学系，佛罗里达州立大学）；Department of Mathematical Sciences, Seoul National University（数学科学系，首尔国立大学）；Department of AI, Chung-Ang University（人工智能系， Chung-Ang 大学）
Variational formulations of time-dependent PDEs in space and time yield $(d+1)$-dimensional problems to be solved numerically. This increases the number of unknowns as well as the storage amount. On the other hand, this approach enables adaptivity in space and time as well as model reduction w.r.t. both type of variables. In this paper, we show that matrix oriented techniques can significantly reduce the computational timings for solving the arising linear systems outperforming both time-stepping schemes and other solvers.
This paper reviews the adaptive sparse grid discontinuous Galerkin (aSG-DG) method for computing high dimensional partial differential equations (PDEs) and its software implementation. The C\texttt{++} software package called AdaM-DG, implementing the aSG-DG method, is available on Github at \url{https://github.com/JuntaoHuang/adaptive-multiresolution-DG}. The package is capable of treating a large class of high dimensional linear and nonlinear PDEs. We review the essential components of the algorithm and the functionality of the software, including the multiwavelets used, assembling of biline…
