Time integration methods for solving initial value problems are an important component of many scientific and engineering simulations. Implicit time integrators are desirable for their stability properties, significantly relaxing restrictions on timestep size. However, implicit methods require solutions to one or more systems of nonlinear equations at each timestep, which for large simulations can be prohibitively expensive. This paper introduces a new family of linearly implicit multistep methods (LIMM), which only requires the solution of one linear system per timestep. Order conditions and stability theory for these methods are presented, as well as design and implementation considerations. Practical methods of order up to five are developed that have similar error coefficients, but improved stability regions, when compared to the widely used BDF methods. Numerical testing of a self-starting variable stepsize and variable order implementation of the new LIMM methods shows measurable performance improvement over a similar BDF implementation.
We consider the construction of semi-implicit linear multistep methods which can be applied to time dependent PDEs where the separation of scales in additive form, typically used in implicit-explicit (IMEX) methods, is not possible. As shown in Boscarino, Filbet and Russo (2016) for Runge-Kutta methods, these semi-implicit techniques give a great flexibility, and allows, in many cases, the construction of simple linearly implicit schemes with no need of iterative solvers. In this work we develop a general setting for the construction of high order semi-implicit linear multistep methods and ana…
We consider the development of high order space and time numerical methods based on Implicit-Explicit (IMEX) multistep time integrators for hyperbolic systems with relaxation. More specifically, we consider hyperbolic balance laws in which the convection and the source term may have very different time and space scales. As a consequence the nature of the asymptotic limit changes completely, passing from a hyperbolic to a parabolic system. From the computational point of view, standard numerical methods designed for the fluid-dynamic scaling of hyperbolic systems with relaxation present several…
We consider a finite element method with symmetric stabilisation for the discretisation of the transient convection--diffusion equation. For the time-discretisation we consider either the second order backwards differentiation formula or the Crank-Nicolson method. Both the convection term and the associated stabilisation are treated explicitly using an extrapolated approximate solution. We prove stability of the method and the $τ^2 + h^{p+{\frac12}}$ error estimates for the $L^2$-norm under either the standard hyperbolic CFL condition, when piecewise affine ($p=1$) approximation is used, or in…
A finite element discretization with semi-implicit nonlinear multistep scheme for a two-dimensional competition-diffusion system of three competing species with different mobility rates
College of Integrative Sciences and Arts, Arizona State University（亚利桑那州立大学综合科学与艺术学院）；Department of Mathematics, Jimma University（吉马大学数学系）；Department of Mathematics and Applied Mathematics, University of the Western Cape（西开普大学数学与应用数学系）
Stability analysis of consistent splitting implicit-explicit multistep methods up to ninth-order accuracy for incompressible flows
School of Mathematics, Nanjing University of Aeronautics and Astronautics（南京航空航天大学数学学院）；Key Laboratory of Mathematical Modeling and High Performance Computing of Air Vehicles (NUAA), MIIT（航空飞行器数学建模与高性能计算教育部重点实验室（南航））；School of Mathematics, Nanjing Audit University（南京审计大学数学学院）
Energy Dissipation Analysis of Implicit-Explicit Linear Multistep Methods for Gradient Flows Using General Multipliers
The Chinese University of Hong Kong (Shenzhen)（香港中文大学（深圳））；Shenzhen International Center for Industrial and Applied Mathematics, Shenzhen Research Institute of Big Data（深圳大数据研究院深圳市工业与应用数学中心）；Xiamen University（厦门大学）
Deterministic solutions of the Boltzmann equation represent a real challenge due to the enormous computational effort which is required to produce such simulations and often stochastic methods such as Direct Simulation Monte Carlo (DSMC) are used instead due to their lower computational cost. In this work, we show that combining different technologies for the discretization of the velocity space and of the physical space coupled with suitable time integration techniques, it is possible to compute very precise deterministic approximate solutions of the Boltzmann model in different regimes, from…
A semi-generating function approach to the stability of implicit-explicit multistep methods for nonlinear parabolic equations
Nanjing University of Aeronautics and Astronautics（南京航空航天大学）；Key Laboratory of Mathematical Modeling and High Performance Computing of Air Vehicles (NUAA), MIIT（航空飞行器数学建模与高性能计算重点实验室（工信部））；The Chinese University of Hong Kong (Shenzhen)（香港中文大学（深圳））；Shenzhen International Center for Industrial and Applied Mathematics, Shenzhen Research Institute of Big Data（深圳市大数据研究院工业与应用数学国际中心）；Guangzhou Nanfang College（广州南方学院）；Academy of Mathematics and Systems Science, Chinese Academy of Sciences（中国科学院数学与系统科学研究院）
The purpose of this work is to introduce a new idea of how to avoid the factorization of large matrices during the solution of stiff systems of ODEs. Starting from the general form of an explicit linear multistep method we suggest to adaptively choose its coefficients on each integration step in order to minimize the norm of the residual of an implicit BDF formula. Thereby we reduce the number of unknowns on each step from $n$ to $O(1)$, where $n$ is the dimension of the ODE system. We call this type of methods Minimal Residual Multistep (MRMS) methods. In the case of linear non-autonomous pro…
We present and investigate a new type of implicit fractional linear multistep method of order two for fractional initial value problems. The method is obtained from the second order super convergence of the Grünwald-Letnikov approximation of the fractional derivative at a non-integer shift point. The proposed method is of order two consistency and coincides with the backward difference method of order two for classical initial value problems when the order of the derivative is one. The weight coefficients of the proposed method are obtained from the Grünwald weights and hence computationally e…
This paper proposes several explicit and implicit multistep frequency response optimized integrators considering first or second order derivative. A prediction-based method aiming at accelerating a novel power system transient simulation scheme without impacting its accuracy is further put forward utilizing the proposed numerical integrators and some others available in the literature. Case studies verify the effectiveness of the proposed prediction method. Although they are utilized to accelerate the simulation scheme in this paper, the proposed numerical integrators are in fact general-purpo…
Implicit-explicit (IMEX) time stepping methods can efficiently solve differential equa- tions with both stiff and nonstiff components. IMEX Runge-Kutta methods and IMEX linear multistep methods have been studied in the literature. In this pa- per we study new implicit-explicit methods of general linear type (IMEX-GLMs). We develop an order conditions theory for high stage order partitioned GLMs that share the same abscissae, and show that no additional coupling order conditions are needed. Consequently, GLMs offer an excellent framework for the construction of multi-method integration algorith…
Systems driven by multiple physical processes are central to many areas of science and engineering. Time discretization of multiphysics systems is challenging, since different processes have different levels of stiffness and characteristic time scales. The multimethod approach discretizes each physical process with an appropriate numerical method; the methods are coupled appropriately such that the overall solution has the desired accuracy and stability properties. The authors developed the general-structure additive Runge-Kutta (GARK) framework, which constructs multimethods based on Runge-Ku…
We present linearly implicit methods that preserve discrete approximations to local and global energy conservation laws for multi-symplectic PDEs with cubic invariants. The methods are tested on the one-dimensional Korteweg-de Vries equation and the two-dimensional Zakharov-Kuznetsov equation; the numerical simulations confirm the conservative properties of the methods, and demonstrate their good stability properties and superior running speed when compared to fully implicit schemes.
Many complex applications require the solution of initial-value problems where some components change fast, while others vary slowly. Multirate schemes apply different step sizes to resolve different components of the system, according to their dynamics, in order to achieve increased computational efficiency. The stiff components of the system, fast or slow, are best discretized with implicit base methods in order to ensure numerical stability. To this end, linearly implicit methods are particularly attractive as they solve only linear systems of equations at each step. This paper develops the…
We consider a kind of differential equations d/dt y(t) = R(y(t))y(t) + f(y(t)) with energy conservation. Such conservative models appear for instance in quantum physics, engineering and molecular dynamics. A new class of energy-preserving schemes is constructed by the ideas of scalar auxiliary variable (SAV) and splitting, from which the nonlinearly implicit schemes have been improved to be linearly implicit. The energy conservation and error estimates are rigorously derived. Based on these results, it is shown that the new proposed schemes have unconditionally energy stability and can be impl…
Kahan's method and a two-step generalization of the discrete gradient method are both linearly implicit methods that can preserve a modified energy for Hamiltonian systems with a cubic Hamiltonian. These methods are here investigated and compared. The schemes are applied to the Korteweg-de Vries equation and the Camassa-Holm equation, and the numerical results are presented and analysed.
We present a new linearly implicit exponential integrator that preserves the polynomial first integrals or Lyapunov functions for the conservative and dissipative stiff equations, respectively. The method is tested by both oscillated ordinary differential equations and partial differential equations, e.g., an averaged system in wind-induced oscillation, the Fermi-Pasta-Ulam systems, and the polynomial pendulum oscillators. The numerical simulations confirm the conservative properties of the proposed method and demonstrate its good behavior in superior running speed when compared with fully imp…
We propose a Fourier pseudo-spectral scheme for the space-fractional nonlinear Schrödinger equation. The proposed scheme has the following features: it is linearly implicit, it preserves two invariants of the equation, its unique solvability is guaranteed without any restrictions on space and time step sizes. The scheme requires solving a complex symmetric linear system per time step. To solve the system efficiently, we also present a certain variable transformation and preconditioner.
In this paper, we generalize the exponential energy-preserving integrator proposed in the recent paper [SIAM J. Sci. Comput. 38(2016) A1876-A1895] for conservative systems, which now becomes linearly implicit by further utilizing the idea of the scalar auxiliary variable approach. Comparing with the original exponential energy-preserving integrator which usually leads to a nonlinear algebraic system, our new method only involve a linear system with constant coefficient matrix. Taking the nonlinear Klein-Gordon equation for example, we derive the concrete energy-preserving scheme and demonstrat…
In this paper, we propose linearly implicit and arbitrary high-order conservative numerical schemes for ordinary differential equations with a quadratic invariant. Many differential equations have invariants, and numerical schemes for preserving them have been extensively studied. Since linear invariants can be easily kept after discretisation, quadratic invariants are essentially the simplest ones. Quadratic invariants are important objects that appear not only in many physical examples but also in the computationally efficient conservative schemes for general invariants such as scalar auxili…
In this paper, we present and analyze an energy-conserving and linearly implicit scheme for solving the nonlinear wave equations. Optimal error estimates in time and superconvergent error estimates in space are established without time-step dependent on the spatial mesh size. The key is to estimate directly the solution bounds in the $H^2$-norm for both the nonlinear wave equation and the corresponding fully discrete scheme, while the previous investigations rely on the temporal-spatial error splitting approach. Numerical examples are presented to confirm energy-conserving properties, uncondit…
In this paper we derive and analyse a class of linearly implicit schemes which includes the one of Feistauer and Kučera (JCP 2007) as well as the class of RS-IMEX schemes. The implicit part is based on a Jacobian matrix which is evaluated at a reference state. This state can be either the solution at the old time level as in Feistauer and Kučera (JCP 2007), or a numerical approximation of the incompressible limit equations as in Zeifang et al. (Commun. Comput. Phys. 2009), or possibly another state. Subsequently, it is shown that this class of methods is asymptotically preserving under the ass…
This paper aims to develop a linearly implicit structure-preserving numerical scheme for the space fractional sine-Gordon equation, which is based on the newly developed invariant energy quadratization method. First, we reformulate the equation as a canonical Hamiltonian system by virtue of the variational derivative of the functional with fractional Laplacian. Then, we utilize the fractional centered difference formula to discrete the equivalent system derived by the invariant energy quadratization method in space direction, and obtain a conservative semi-discrete scheme. Subsequently, the li…
Variable steps implicit-explicit multistep methods for PDEs have been presented in [17], where the zero-stability is studied for ODEs; however, the stability analysis still remains an open question for PDEs. Based on the idea of linear multistep methods, we present a simple weighted and shifted BDF2 methods with variable steps for the parabolic problems, which serve as a bridge between BDF2 and Crank-Nicolson scheme. The contributions of this paper are as follows: we first prove that the optimal adjacent time-step ratios for the weighted and shifted BDF2, which greatly improve the maximum time…
In this paper, we develop a novel, linearly implicit and local energy-preserving scheme for the sine-Gordon equation. The basic idea is from the invariant energy quadratization approach to construct energy stable schemes for gradient systems, which are energy dispassion. We here take the sine-Gordon equation as an example to show that the invariant energy quadratization approach is also an efficient way to construct linearly implicit and local energy-conserving schemes for energy-conserving systems. Utilizing the invariant energy quadratization approach, the sine-Gordon equation is first refor…
For the Landau--Lifshitz--Gilbert (LLG) equation of micromagnetics we study linearly implicit backward difference formula (BDF) time discretizations up to order $5$ combined with higher-order non-conforming finite element space discretizations, which are based on the weak formulation due to Alouges but use approximate tangent spaces that are defined by $L^2$-averaged instead of nodal orthogonality constraints. We prove stability and optimal-order error bounds in the situation of a sufficiently regular solution. For the BDF methods of orders $3$ to~$5$, this requires %a mild time step restricti…
In this paper, we present a linearly implicit energy-preserving scheme for the Camassa-Holm equation by using the multiple scalar auxiliary variables approach, which is first developed to construct efficient and robust energy stable schemes for gradient systems. The Camassa-Holm equation is first reformulated into an equivalent system by utilizing the multiple scalar auxiliary variables approach, which inherits a modified energy. Then, the system is discretized in space aided by the standard Fourier pseudo-spectral method and a semi-discrete system is obtained, which is proven to preserve a se…
On General Linearly Implicit Quantized State System Methods
French-Argentine International Center for Information and System Sciences (CIFASIS), CONICET（法国-阿根廷信息与系统科学国际中心 (CIFASIS)，阿根廷国家科学研究委员会）；FCEIA, Universidad Nacional de Rosario（罗萨里奥国立大学经济与工商学院）
A novel class of high-order linearly implicit energy-preserving integrating factor Runge-Kutta methods are proposed for the nonlinear Schrödinger equation. Based on the idea of the scalar auxiliary variable approach, the original equation is first reformulated into an equivalent form which satisfies a quadratic energy. The spatial derivatives of the system are then approximated with the standard Fourier pseudo-spectral method. Subsequently, we apply the extrapolation technique/prediction-correction strategy to the nonlinear terms of the semi-discretized system and a linearized energy-conservin…
Conservation properties of iterative methods applied to implicit finite volume discretizations of nonlinear conservation laws are analyzed. It is shown that any consistent multistep or Runge-Kutta method is globally conservative. Further, it is shown that Newton's method, Krylov subspace methods and pseudo-time iterations are globally conservative while the Jacobi and Gauss-Seidel methods are not in general. If pseudo-time iterations using an explicit Runge-Kutta method are applied to a locally conservative discretization, then the resulting scheme is also locally conservative. However, the co…
In many applications, the governing PDE to be solved numerically contains a stiff component. When this component is linear, an implicit time stepping method that is unencumbered by stability restrictions is often preferred. On the other hand, if the stiff component is nonlinear, the complexity and cost per step of using an implicit method is heightened, and explicit methods may be preferred for their simplicity and ease of implementation. In this article, we analyze new and existing linearly stabilized schemes for the purpose of integrating stiff nonlinear PDEs in time. These schemes compute t…
In this paper, we develop a novel class of linear energy-preserving integrating factor methods for the 2D nonlinear Schrödinger equation with wave operator (NLSW), combining the scalar auxiliary variable approach and the integrating factor methods. A second-order scheme is first proposed, which is rigorously proved to be energy-preserving. By using the energy methods, we analyze its optimal convergence in the $H^1$ norm without any restrictions on the grid ratio, where a novel technique and an improved induction argument are proposed to overcome the difficulty posed by the unavailability of a …
This paper introduces a new class of numerical methods for the time integration of evolution equations set as Cauchy problems of ODEs or PDEs. The systematic design of these methods mixes the Runge-Kutta collocation formalism with collocation techniques, in such a way that the methods are linearly implicit and have high order. The fact that these methods are implicit allows to avoid CFL conditions when the large systems to integrate come from the space discretization of evolution PDEs. Moreover, these methods are expected to be efficient since they only require to solve one linear system of eq…
