This work studies the parallelization and empirical convergence of two finite difference acoustic wave propagation methods on 2-D rectangular grids, that use the same alternating direction implicit (ADI) time integration. This ADI integration is based on a second-order implicit Crank-Nicolson temporal discretization that is factored out by a Peaceman-Rachford decomposition of the time and space equation terms. In space, these methods highly diverge and apply different fourth-order accurate differentiation techniques. The first method uses compact finite differences (CFD) on nodal meshes that requires solving tridiagonal linear systems along each grid line, while the second one employs staggered-grid mimetic finite differences (MFD). For each method, we implement three parallel versions: (i) a multithreaded code in Octave, (ii) a C++ code that exploits OpenMP loop parallelization, and (iii) a CUDA kernel for a NVIDIA GTX 960 Maxwell card. In these implementations, the main source of parallelism is the simultaneous ADI updating of each wave field matrix, either column-wise or row-wise, according to the differentiation direction. In our numerical applications, the highest performances are displayed by the CFD and MFD CUDA codes that achieve speedups of 7.21x and 15.81x, respectively, relative to their C++ sequential counterparts with optimal compilation flags. Our test cases also allow to assess the numerical convergence and accuracy of both methods. In a problem with exact harmonic solution, both methods exhibit convergence rates close to 4 and the MDF accuracy is practically higher. Alternatively, both convergences decay to second order on smooth problems with severe gradients at boundaries, and the MDF rates degrade in highly-resolved grids leading to larger inaccuracies. This transition of empirical convergences agrees with the nominal truncation errors in space and time.
In this paper, applying the Newton method, we transform the complex continuous-time algebraic Riccati matrix equation into a Lyapunov equation. Then, we introduce an efficient general alternating-direction implicit (GADI) method to solve the Lyapunov equation. The inexact Newton-GADI method is presented to save computational amount effectively. Moreover, we analyze the convergence of the Newton-GADI method. The convergence rate of the Newton-GADI and Newton-ADI methods is compared by analyzing their spectral radii. Furthermore, we give a way to select the quasi-optimal parameter. Corresponding…
Alternating Directions Implicit (ADI) integration is an operator splitting approach to solve parabolic and elliptic partial differential equations in multiple dimensions based on solving sequentially a set of related one-dimensional equations. Classical ADI methods have order at most two, due to the splitting errors. Moreover, when the time discretization of stiff one-dimensional problems is based on Runge-Kutta schemes, additional order reduction may occur. This work proposes a new ADI approach based on the partitioned General Linear Methods framework. This approach allows the construction of…
An alternating direction implicit spectral method for solving two dimensional multi-term time fractional mixed diffusion and diffusion-wave equations
School of Mathematics and Statistics, Beijing Institute of Technology（北京理工大学数学与统计学院）；School of Mathematical Sciences, Queensland University of Technology（昆士兰科技大学理学院）
We focus on non-stationary Maxwell equations defined on a regular patch of elements as considered in the isogeometric analysis (IGA). We apply the time-integration scheme following the ideas developed by the finite difference community [M. Hochbruck, T. Jahnke, R. Schnaubelt, Convergence of an ADI splitting for Maxwell's equations, Numerishe Mathematik, 2015] to derive a weak formulation resulting in discretization with Kronecker product matrices. We take the tensor product structure of the computational patch of elements from the IGA framework as an advantage, allowing for linear computationa…
This paper proposes an efficient general alternating-direction implicit (GADI) framework for solving large sparse linear systems. The convergence property of the GADI framework is discussed. Most of the existing ADI methods can be viewed as particular schemes of the developed framework. Meanwhile the GADI framework can derive new ADI methods. Moreover, as the algorithm efficiency is sensitive to the splitting parameters, we offer a data-driven approach, the Gaussian process regression (GPR) method based on the Bayesian inference, to predict the GADI framework's relatively optimal parameters. T…
In this paper we generalize the polynomial time integration framework to additively partitioned initial value problems. The framework we present is general and enables the construction of many new families of additive integrators with arbitrary order-of-accuracy and varying degree of implicitness. In this first work, we focus on a new class of implicit-explicit polynomial block methods that are based on fully-implicit Runge-Kutta methods with Radau nodes, and possess high stage order. We show that the new fully-implicit-explicit (FIMEX) integrators have improved stability compared to existing …
We use the alternating direction method to simulate implicit dynamics. ur spatial discretization uses isogeometric analysis. Namely, we simulate a (hyperbolic) wave propagation problem in which we use tensor-product B-splines in space and an implicit time marching method to fully discretize the problem. We approximate our discrete operator as a Kronecker product of one-dimensional mass and stiffness matrices. As a result of this algebraic transformation, we can factorize the resulting system of equations in linear (i.e., O(N)) time at each step of the implicit method. We demonstrate the perfor…
In this paper, we propose a novel computational implicit method, which we call Isogeometric Residual Minimization (iGRM) with direction splitting. The method mixes the benefits resulting from isogeometric analysis, implicit dynamics, residual minimization, and alternating direction solver. We utilize tensor product B-spline basis functions in space, implicit second order time integration schemes, residual minimization in every time step, and we exploit Kronecker product structure of the matrix to employ linear computational cost alternating direction solver. We implement an implicit time integ…
Splitting-based time integration approaches such as fractional steps, alternating direction implicit, operator splitting, and locally one-dimensional methods partition the system of interest into components and solve individual components implicitly in a cost-effective way. This work proposes a unified formulation of splitting time integration schemes in the framework of general-structure additive Runge-Kutta (GARK) methods. Specifically, we develop implicit-implicit (IMIM) GARK schemes, provide the order conditions and stability analysis for this class, and explain their application to partit…
Alternating least squares is the most widely used algorithm for CP tensor decomposition. However, alternating least squares may exhibit slow or no convergence, especially when high accuracy is required. An alternative approach is to regard CP decomposition as a nonlinear least squares problem and employ Newton-like methods. Direct solution of linear systems involving an approximated Hessian is generally expensive. However, recent advancements have shown that use of an implicit representation of the linear system makes these methods competitive with alternating least squares. We provide the fir…
We present a novel fully implicit hybrid finite volume/finite element method for incompressible flows. Following previous works on semi-implicit hybrid FV/FE schemes, the incompressible Navier-Stokes equations are split into a pressure and a transport-diffusion subsystem. The first of them can be seen as a Poisson type problem and is thus solved efficiently using classical continuous Lagrange finite elements. On the other hand, finite volume methods are employed to solve the convective subsystem, in combination with Crouzeix-Raviart finite elements for the discretization of the viscous stress …
Implicit integration of the viscous term can significantly improve performance in computational fluid dynamics for highly viscous fluids such as lava. We show improvements over our previous proposal for semi-implicit viscous integration in Smoothed Particle Hydrodynamics, extending it to support a wider range of boundary models. Due to the resulting loss of matrix symmetry, a key advancement is a more robust version of the biconjugate gradient stabilized method to solve the linear systems, that is also better suited for parallelization in both shared-memory and distributed-memory systems. The …
A second-order $L$-stable exponential time-differencing (ETD) method is developed by combining an ETD scheme with approximating the matrix exponentials by rational functions having real distinct poles (RDP), together with a dimensional splitting integrating factor technique. A variety of non-linear reaction-diffusion equations in two and three dimensions with either Dirichlet, Neumann, or periodic boundary conditions are solved with this scheme and shown to outperform a variety of other second-order implicit-explicit schemes. An additional performance boost is gained through further use of bas…
In this paper, a second-order backward difference formula (abbr. BDF2) is used to approximate first-order time partial derivative, the Riesz fractional derivatives are approximated by fourth-order compact operators, a class of new alternating-direction implicit difference scheme (abbr. ADI) is constructed for two-dimensional Riesz space fractional nonlinear reaction-diffusion equation. Stability and convergence of the numerical method are analyzed. Numerical experiments demonstrate that the proposed method is effective.
This paper presents the generalized formulations of fundamental schemes for efficient unconditionally stable implicit finite-difference time-domain (FDTD) methods. The fundamental schemes constitute a family of implicit schemes that feature similar fundamental updating structures, which are in simplest forms with most efficient right-hand sides. The formulations of fundamental schemes are presented in terms of generalized matrix operator equations pertaining to some classical splitting formulae, including those of alternating direction implicit, locally one-dimensional and split-step schemes. …
In this paper, a compact alternating direction implicit (ADI) method has been developed for solving two-dimensional Riesz space fractional diffusion equation. The precision of the discretization method used in spatial directions is twice the order of the corresponding fractional derivatives. It is proved that the proposed method is unconditionally stable via the matrix analysis method and the maximum error in achieving convergence is discussed. Several numerical examples are considered aiming to demonstrate the validity and applicability of the proposed technique.
The parallel full approximation scheme in space and time (PFASST) introduced by Emmett and Minion in 2012 is an iterative strategy for the temporal parallelization of ODEs and discretized PDEs. As the name suggests, PFASST is similar in spirit to a space-time FAS multigrid method performed over multiple time-steps in parallel. However, since the original focus of PFASST has been on the performance of the method in terms of time parallelism, the solution of any spatial system arising from the use of implicit or semi-implicit temporal methods within PFASST have simply been assumed to be solved t…
Compared to other symplectic integrators (the Wisdom and Holman map and its higher order generalizations) that also take advantage of the hierarchical nature of the motion of the planets around the central star, our methods require solving implicit equations at each time-step. We claim that, despite this disadvantage, FCIRK16 is more efficient than explicit symplectic integrators for high precision simulations thanks to: (i) its high order of precision, (ii) its easy parallelization, and (iii) its efficient mixed-precision implementation which reduces the effect of round-off errors. In additio…
In this paper, by combining of fractional centered difference approach with alternating direction implicit method, we introduce a mixed difference method for solving two-dimensional Riesz space fractional advection-dispersion equation. The proposed method is a fourth order centered difference operator in spatial directions and second order Crank-Nicolson method in temporal direction. By reviewing the consistency and stability of the method, the convergence of the proposed method is achieved. Several numerical examples are considered aiming to demonstrate the validity and applicability of the p…
The Peaceman-Rachford alternating direction implicit (ADI) scheme for linear time-dependent Maxwell equations is analyzed on a heterogeneous cuboid. Due to discontinuities of the material parameters, the solution of the Maxwell equations is less than $H^2$-regular in space. For the ADI scheme, we prove a rigorous time-discrete error bound with a convergence rate that is half an order lower than the classical one. Our statement imposes only assumptions on the initial data and the material parameters, but not on the solution. To establish this result, we analyze the regularity of the Maxwell equ…
