We propose new domain decomposition methods for systems of partial differential equations in two and three dimensions. The algorithms are derived with the help of the Smith factorization of the operator. This could also be validated by numerical experiments.
In this paper, we employed linear algebra and functional analysis to determine necessary and sufficient conditions for oscillation-free and stable solutions to linear and nonlinear parabolic partial differential equations. We applied singular value decomposition and Fourier analysis to various finite difference schemes to extract patterns in the eigenfunctions (sampled by the eigenvectors) and the shape of their eigenspectrum. With these, we determined how the initial and boundary conditions affect the frequency and long term behavior of numerical oscillations, as well as the location of solut…
A local approach to the time integration of PDEs by exponential methods is proposed, motivated by theoretical estimates by A.Iserles on the decay of off-diagonal terms in the exponentials of sparse matrices. An overlapping domain decomposition technique is outlined, that allows to replace the computation of a global exponential matrix by a number of independent and easily parallelizable local problems. Advantages and potential problems of the proposed technique are discussed. Numerical experiments on simple, yet relevant model problems show that the resulting method allows to increase computat…
The DD-CPM software library provides a set of tools for the discretization and solution of problems arising from the closest point method (CPM) for partial differential equations on surfaces. The solvers are built on top of the well-known PETSc framework, and are supplemented by custom domain decomposition (DD) preconditioners specific to the CPM. These solvers are fully compatible with distributed memory parallelism through MPI. This library is particularly well suited to the solution of elliptic and parabolic equations, including many reaction-diffusion equations. The software is detailed he…
Dynamic mode decomposition (DMD) is a powerful data-driven technique for construction of reduced-order models of complex dynamical systems. Multiple numerical tests have demonstrated the accuracy and efficiency of DMD, but mostly for systems described by partial differential equations (PDEs) with homogeneous boundary conditions. We propose an extended dynamic mode decomposition (xDMD) approach to cope with the potential unknown sources/sinks in PDEs. Motivated by similar ideas in deep neural networks, we equipped our xDMD with two new features. First, it has a bias term, which accounts for inh…
We introduce the multivariate decomposition finite element method (MDFEM) for solving elliptic PDEs with uniform random diffusion coefficients. We show that the MDFEM can be used to reduce the computational complexity of estimating the expected value of a linear functional of the solution of the PDE. The proposed algorithm combines the multivariate decomposition method (MDM), to compute infinite dimensional integrals, with the finite element method (FEM), to solve different instances of the PDE. The strategy of the MDFEM is to decompose the infinite-dimensional problem into multiple finite-dim…
ShanghaiTech University（上海科技大学）；University of Southern California（南加州大学）
A state-of-the-art deep domain decomposition method (D3M) based on the variational principle is proposed for partial differential equations (PDEs). The solution of PDEs can be formulated as the solution of a constrained optimization problem, and we design a multi-fidelity neural network framework to solve this optimization problem. Our contribution is to develop a systematical computational procedure for the underlying problem in parallel with domain decomposition. Our analysis shows that the D3M approximation solution converges to the exact solution of underlying PDEs. Our proposed framework …
In this paper we present a Fourier feature based deep domain decomposition method (F-D3M) for partial differential equations (PDEs). Currently, deep neural network based methods are actively developed for solving PDEs, but their efficiency can degenerate for problems with high frequency modes. In this new F-D3M strategy, overlapping domain decomposition is conducted for the spatial domain, such that high frequency modes can be reduced to relatively low frequency ones. In each local subdomain, multi Fourier feature networks (MFFNets) are constructed, where efficient boundary and interface treat…
Deep learning-based reduced order models (DL-ROMs) have been recently proposed to overcome common limitations shared by conventional reduced order models (ROMs) - built, e.g., through proper orthogonal decomposition (POD) - when applied to nonlinear time-dependent parametrized partial differential equations (PDEs). These might be related to (i) the need to deal with projections onto high dimensional linear approximating trial manifolds, (ii) expensive hyper-reduction strategies, or (iii) the intrinsic difficulty to handle physical complexity with a linear superimposition of modes. All these as…
Error estimates for POD-DL-ROMs: a deep learning framework for reduced order modeling of nonlinear parametrized PDEs enhanced by proper orthogonal decomposition
Domain decomposition (DD) methods are widely used as preconditioner techniques. Their effectiveness relies on the choice of a locally constructed coarse space. Thus far, this construction was mostly achieved using non-assembled matrices from discretized partial differential equations (PDEs). Therefore, DD methods were mainly successful when solving systems stemming from PDEs. In this paper, we present a fully algebraic multilevel DD method where the coarse space can be constructed locally and efficiently without any information besides the coefficient matrix. The condition number of the precon…
We introduce the multivariate decomposition finite element method for elliptic PDEs with lognormal diffusion coefficient $a=\exp(Z)$ where $Z$ is a Gaussian random field defined by an infinite series expansion $Z(\boldsymbol{y}) = \sum_{j\ge1} y_j\,ϕ_j$ with $y_j\sim\mathcal{N}(0,1)$ and a given sequence of functions $\{ϕ_j\}_{j\ge1}$. We use the MDFEM to approximate the expected value of a linear functional of the solution of the PDE which is an infinite-dimensional integral over the parameter space. The proposed algorithm uses the multivariate decomposition method (MDM) to compute the infini…
In this article, we present a parallel recursive algorithm based on multi-level domain decomposition that can be used as a precondtioner to a Krylov subspace method to solve sparse linear systems of equations arising from the discretization of partial differential equations (PDEs). We tested the effectiveness of the algorithm on several PDEs using different number of sub-domains (ranging from 8 to 32768) and various problem sizes (ranging from about 2000 to over a billion degrees of freedom). We report the results from these tests; the results show that the algorithm scales very well with the …
Based on the Fourier extension, we propose an oversampling collocation method for solving the elliptic partial differential equations with variable coefficients over arbitrary irregular domains. This method only uses the function values on the equispaced nodes, which has low computational cost and versatility. While a variety of numerical experiments are presented to demonstrate the effectiveness of this method, it shows that the approximation error fast reaches a plateau with increasing the degrees of freedom, due to the inherent ill-conditioned of frames.
We describe a numerical framework that uses random sampling to efficiently capture low-rank local solution spaces of multiscale PDE problems arising in domain decomposition. In contrast to existing techniques, our method does not rely on detailed analytical understanding of specific multiscale PDEs, in particular, their asymptotic limits. We present the application of the framework on two examples --- a linear kinetic equation and an elliptic equation with rough media. On these two examples, this framework achieves the asymptotic preserving property for the kinetic equations and numerical homo…
Hermite spectral collocation methods for fractional PDEs in unbounded domains
Southern University of Sciences and Technology（南方科技大学）；Hong Kong Baptist University（香港浸会大学）；Institute of Computational Mathematics, Academy of Mathematics and Systems Science, Chinese Academy of Sciences（中国科学院数学与系统科学研究院计算数学研究所）
In this work we develop a novel domain splitting strategy for the solution of partial differential equations. Focusing on a uniform discretization of the $d$-dimensional advection-diffusion equation, our proposal is a two-level algorithm that merges the solutions obtained from the discretization of the equation over highly anisotropic submeshes to compute an initial approximation of the fine solution. The algorithm then iteratively refines the initial guess by leveraging the structure of the residual. Performing costly calculations on anisotropic submeshes enable us to reduce the dimensionalit…
Coupled partial differential equations defined on domains with different dimensionality are usually called mixed dimensional PDEs. We address mixed dimensional PDEs on three-dimensional (3D) and one-dimensional domains, giving rise to a 3D-1D coupled problem. Such problem poses several challenges from the standpoint of existence of solutions and numerical approximation. For the coupling conditions across dimensions, we consider the combination of essential and natural conditions, basically the combination of Dirichlet and Neumann conditions. To ensure a meaningful formulation of such condition…
In this contribution, we coupled the isogeometric analysis to a reduced order modelling technique in order to provide a computationally efficient solution in parametric domains. In details, we adopt the free-form deformation method to obtain the parametric formulation of the domain and proper orthogonal decomposition with interpolation for the computational reduction of the model. This technique provides a real-time solution for any parameter by combining several solutions, in this case computed using isogeometric analysis on different geometrical configurations of the domain, properly mapped …
Problems with topological uncertainties appear in many fields ranging from nano-device engineering to the design of bridges. In many of such problems, a part of the domains boundaries is subjected to random perturbations making inefficient conventional schemes that rely on discretization of the whole domain. In this paper, we study elliptic PDEs in domains with boundaries comprised of a deterministic part and random apertures, and apply the method of modified potentials with Green's kernels defined on the deterministic part of the domain. This approach allows to reduce the dimension of the ori…
We propose a new discretization method for PDEs on moving domains in the setting of unfitted finite element methods, which is provably higher-order accurate in space and time. In the considered setting, the physical domain that evolves essentially arbitrarily through a time-independent computational background domain, is represented by a level set function. For the time discretization, the application of standard time stepping schemes that are based on finite difference approximations of the time derivative is not directly possible, as the degrees of freedom may get active or inactive across s…
The quantification of multivariate uncertainties in partial differential equations can easily exceed any computing capacity unless proper measures are taken to reduce the complexity of the model. In this work, we propose a multidimensional Galerkin Proper Orthogonal Decomposition that optimally reduces each dimension of a tensorized product space. We provide the analytical framework and results that define and quantify the low-dimensional approximation. We illustrate its application for uncertainty modeling with Polynomial Chaos Expansions and show its efficiency in a numerical example.
In this paper, we propose a fast spectral-Galerkin method for solving PDEs involving integral fractional Laplacian in $\mathbb{R}^d$, which is built upon two essential components: (i) the Dunford-Taylor formulation of the fractional Laplacian; and (ii) Fourier-like bi-orthogonal mapped Chebyshev functions (MCFs) as basis functions. As a result, the fractional Laplacian can be fully diagonalised, and the complexity of solving an elliptic fractional PDE is quasi-optimal, i.e., $O((N\log_2N)^d)$ with $N$ being the number of modes in each spatial direction. Ample numerical tests for various decayi…
In this paper, we propose different algorithms for the solution of a tensor linear discrete ill-posed problem arising in the application of the meshless method for solving PDEs in three-dimensional space using multiquadric radial basis functions. It is well known that the truncated singular value decomposition (TSVD) is the most common effective solver for ill-conditioned systems, but unfortunately the operation count for solving a linear system with the TSVD is computationally expensive for large-scale matrices. In the present work, we propose algorithms based on the use of the well known Ein…
Multi-Scale Finite Expression Method for PDEs with Oscillatory Solutions on Complex Domains
Department of Mathematics, Purdue University（普渡大学数学系）；Department of Mathematics and Department of Computer Science, University of Maryland College Park（马里兰大学学院市数学系和计算机科学系）
The discretization of elliptic PDEs leads to large coupled systems of equations. Domain decomposition methods (DDMs) are one approach to the solution of these systems, and can split the problem in a way that allows for parallel computing. Herein, we extend two DDMs to elliptic PDEs posed intrinsic to surfaces as discretized by the Closest Point Method (CPM) \cite{SJR:CPM,CBM:ICPM}. We consider the positive Helmholtz equation $\left(c-Δ_\mathcal{S}\right)u = f$, where $c\in\mathbb{R}^+$ is a constant and $Δ_\mathcal{S}$ is the Laplace-Beltrami operator associated with the surface $\mathcal{S}\s…
Rational spectral methods for PDEs involving fractional Laplacian in unbounded domains
Southern University of Sciences and Technology（南方科技大学）；Nanyang Technological University（南洋理工大学）；Hong Kong Baptist University（香港浸会大学）；Institute of Computational Mathematics, Academy of Mathematics and Systems Science, Chinese Academy of Sciences（中国科学院数学与系统科学研究院计算数学研究所）
In this article, an advanced differential quadrature (DQ) approach is proposed for the high-dimensional multi-term time-space-fractional partial differential equations (TSFPDEs) on convex domains. Firstly, a family of high-order difference schemes is introduced to discretize the time-fractional derivative and a semi-discrete scheme for the considered problems is presented. We strictly prove its unconditional stability and error estimate. Further, we derive a class of DQ formulas to evaluate the fractional derivatives, which employs radial basis functions (RBFs) as test functions. Using these D…
Numerical solutions to wave-type PDEs utilizing method-of-lines require the ODE solver's stability domain to include a large stretch of the imaginary axis surrounding the origin. We show here that extrapolation based solvers of Gragg-Bulirsch-Stoer (GBS) type can meet this requirement. Extrapolation methods utilize several independent time stepping sequences, making them highly suited for parallel execution. Traditional extrapolation schemes use all time stepping sequences to maximize the method's order of accuracy. The present method instead maintains a desired order of accuracy while employi…
IGA-based Multi-Index Stochastic Collocation for random PDEs on arbitrary domains
King Abdullah University of Science and Technology (KAUST)（阿卜杜拉国王科技大学）；Consiglio Nazionale delle Ricerche - Istituto di Matematica Applicata e Tecnologie Informatiche “E. Magenes” (CNR-IMATI)（意大利国家研究委员会应用数学与信息技术研究所）；RWTH Aachen University（亚琛工业大学）
High precision PINNs in unbounded domains: application to singularity formulation in PDEs
California Institute of Technology（加州理工学院）；Massachusetts Institute of Technology（麻省理工学院）；The NSF Institute for Artificial Intelligence and Fundamental Interactions（NSF人工智能与基础相互作用研究所）
