For 2x2 block matrices, it is well-known that block-triangular or block-LDU preconditioners with an exact Schur complement (inverse) converge in at most two iterations for fixed-point or minimal-residual methods. Similarly, for saddle-point matrices with a zero (2,2)-block, block-diagonal preconditioners converge in at most three iterations for minimal-residual methods, although they may diverge for fixed-point iterations. But, what happens for non-saddle-point matrices and block-diagonal preconditioners with an exact Schur complement? This note proves that minimal-residual methods applied to general 2x2 block matrices, preconditioned with a block-diagonal preconditioner, including an exact Schur complement, do not (necessarily) converge in a fixed number of iterations. Furthermore, examples are constructed where (i) block-diagonal preconditioning with an exact Schur complement converges no faster than block-diagonal preconditioning using diagonal blocks of the matrix, and (ii) block-diagonal preconditioning with an approximate Schur complement converges as fast as the corresponding block-triangular preconditioning. The paper concludes by discussing some practical applications in neutral-particle transport, introducing one algorithm where block-triangular or block-LDU preconditioning are superior to block-diagonal, and a second algorithm where block-diagonal preconditioning is superior both in speed and simplicity.
These are lectures notes on support preconditioning, originally written in 2007. The notes cover large sparse linear systems of equations, krylov subspace solvers for symmetric diagonally dominant linear systems, sparse Cholesky, support theory, Laplacians, and augmented maximum-spanning tree preconditioning.
Using the framework of operator or Calderón preconditioning, uniform preconditioners are constructed for elliptic operators discretized with continuous finite (or boundary) elements. The preconditioners are constructed as the composition of an opposite order operator, discretized on the same ansatz space, and two diagonal scaling operators.
In this note we present a multigrid preconditioning method for solving quadratic optimization problems constrained by a fractional diffusion equation. Multigrid methods within the all-at-once approach to solve the first order-order optimality Karush-Kuhn-Tucker (KKT) systems are widely popular, but their development have relied on the underlying systems being sparse. On the other hand, for most discretizations, the matrix representation of fractional operators is expected to be dense. We develop a preconditioning strategy for our problem based on a reduced approach, namely we eliminate the sta…
Convergence and mixed-precision preconditioning for the naive Jacobi eigenvalue algorithm
University of Zagreb Faculty of Chemical Engineering and Technology（萨格勒布大学化学工程与技术学院）；University of Osijek School of Applied Mathematics and Informatics（奥西耶克大学应用数学与信息学院）
We propose an unconditionally robust and highly effective preconditioner for general symmetric positive definite (SPD) matrices based on structured incomplete factorization (SIF), called enhanced SIF (eSIF) preconditioner. The original SIF strategy proposed recently derives a structured preconditioner by applying block diagonal preprocessing to the matrix and then compressing appropriate scaled off-diagonal blocks. Here, we use an enhanced scaling-and-compression strategy to design the new eSIF preconditioner. Some subtle modifications are made, such as the use of two-sided block triangular pr…
We show that preconditioners constructed by random sampling can perform well without meeting the standard requirements of iterative methods. When applied to graph Laplacians, this leads to ultra-sparsifiers that in expectation behave as the nearly-optimal ones given by [Kolla-Makarychev-Saberi-Teng STOC`10]. Combining this with the recursive preconditioning framework by [Spielman-Teng STOC`04] and improved embedding algorithms, this leads to algorithms that solve symmetric diagonally dominant linear systems and electrical flow problems in expected time close to $m\log^{1/2}n$ .
Runge-Kutta (RK) schemes, especially Gauss-Legendre and some other fully implicit RK (FIRK) schemes, are desirable for the time integration of parabolic partial differential equations due to their A-stability and high-order accuracy. However, it is significantly more challenging to construct optimal preconditioners for them compared to diagonally implicit RK (or DIRK) schemes. To address this challenge, we first introduce mathematically optimal preconditioners called block complex Schur decomposition (BCSD), block real Schur decomposition (BRSD), and block Jordan form (BJF), motivated by block…
We propose a preconditioner for the Helmholtz exterior problems on multi-screens. For this, we combine quotient-space BEM and operator preconditioning. For a class of multi-screens (which we dub \emph{type A} multi-screens), we show that this approach leads to block diagonal Calderón preconditioners and results in a spectral condition number that grows only logarithmically with $h$, just as in the case of simple screens. Since the resulting scheme contains many more DoFs than strictly required, we also present strategies to remove almost all redundancy without significant loss of effectiveness…
This paper deals with the fast solution of linear systems associated with the mass matrix, in the context of isogeometric analysis. We propose a preconditioner that is both efficient and easy to implement, based on a diagonal-scaled Kronecker product of univariate parametric mass matrices. Its application is faster than a matrix-vector product involving the mass matrix itself. We prove that the condition number of the preconditioned matrix converges to 1 as the mesh size is reduced, that is, the preconditioner is asymptotically equivalent to the exact inverse. Moreover, we give numerical evide…
The paper focuses on numerical solution of parametrized diffusion equations with scalar parameter-dependent coefficient function by the stochastic (spectral) Galerkin method. We study preconditioning of the related discretized problems using preconditioners obtained by modifying the stochastic part of the partial differential equation. We present a simple but general approach for obtaining two-sided bounds to the spectrum of the resulting matrices, based on a particular splitting of the discretized operator. Using this tool and considering the stochastic approximation space formed by classical…
This is the third part in a series on a mass conserving, high order, mixed finite element method for Stokes flow. In this part, we study a block-diagonal preconditioner for the indefinite Schur complement system arising from the discretization of the Stokes equations using these elements. The underlying finite element method is uniformly stable in both the mesh size h and polynomial order p, and we prove bounds on the eigenvalues of the preconditioned system which are independent of h and grow modestly in p. The analysis relates the Schur complement system to an appropriate variational setting…
In this work, we perform a spectral analysis of flipped multilevel Toeplitz sequences, i.e., we study the asymptotic spectral behaviour of $\{Y_{\boldsymbol{n}}T_{\boldsymbol{n}}(f)\}_{\boldsymbol{n}}$, where $T_{\boldsymbol{n}}(f)$ is a real, square multilevel Toeplitz matrix generated by a function $f\in L^1([-π,π]^d)$ and $Y_{\boldsymbol{n}}$ is the exchange matrix, which has $1$s on the main anti-diagonal. In line with what we have shown for unilevel flipped Toeplitz matrix sequences, the asymptotic spectrum is determined by a $2\times 2$ matrix-valued function whose eigenvalues are $\pm |…
The $p$-step backwards difference formula (BDF) for solving the system of ODEs can result in a kind of all-at-once linear systems, which are solved via the parallel-in-time preconditioned Krylov subspace solvers (see McDonald, Pestana, and Wathen [SIAM J. Sci. Comput., 40(2) (2018): A1012-A1033] and Lin and Ng [arXiv:2002.01108, 17 pages]. However, these studies ignored that the $p$-step BDF ($p\geq 2$) is not selfstarting, when they are exploited to solve time-dependent PDEs. In this note, we focus on the 2-step BDF which is often superior to the trapezoidal rule for solving the Riesz fractio…
The paper focuses on developing and studying efficient block preconditioners based on classical algebraic multigrid for the large-scale sparse linear systems arising from the fully coupled and implicitly cell-centered finite volume discretization of multi-group radiation diffusion equations, whose coefficient matrices can be rearranged into the $(G+2)\times(G+2)$ block form, where $G$ is the number of energy groups. The preconditioning techniques are based on the monolithic classical algebraic multigrid method, physical-variable based coarsening two-level algorithm and two types of block Schur…
In this paper, we study a parallel-in-time (PinT) algorithm for all-at-once system from a non-local evolutionary equation with weakly singular kernel where the temporal term involves a non-local convolution with a weakly singular kernel and the spatial term is the usual Laplacian operator with variable coefficients. We propose to use a two-sided preconditioning technique for the all-at-once discretization of the equation. Our preconditioner is constructed by replacing the variable diffusion coefficients with a constant coefficient to obtain a constant-coefficient all-at-once matrix. We split a…
We propose a uniform block-diagonal preconditioner for condensed $H$(div)-conforming HDG schemes for parameter-dependent saddle point problems, including the generalized Stokes equations and the linear elasticity equations. An optimal preconditioner is obtained for the stiffness matrix on the global velocity/displacement space via the auxiliary space preconditioning (ASP) technique \cite{Xu96}. A spectrally equivalent approximation to the Schur complement on the element-wise constant pressure space is also constructed, and an explicit computable exact inverse is obtained via the Woodbury matri…
Parameter-free inexact block Schur complement preconditioning for linear poroelasticity under a hybrid Bernardi-Raugel and weak Galerkin finite element discretization
Preconditioning of a linear system obtained from spectral discretization of time-dependent PDEs often results in a full matrix which is expensive to compute and store specially when the problem size increases. A matrix-free implementation is usually applied to resolve this issue. In this framework, preconditioning is typically challenging since the entries of the matrix are not explicitly available. In this short note, we propose a statistical approach to gradually create a preconditioner matrix by collecting the information obtained from matrix-vector product in the Arnoldi loop of an unpreco…
Augmented Lagrangian preconditioning for a simplified Ericksen--Leslie model of nematic liquid crystals
College of Science, National University of Defense Technology（国防科技大学理学院）；College of Meteorology and Oceanography, National University of Defense Technology（国防科技大学气象海洋学院）
This note presents several conditions to characterize real matrix similarity between a Hurwitz matrix (and then more generally, a real square matrix) and a diagonal dominant matrix.
This note proposes an efficient preconditioner for solving linear and semi-linear parabolic equations. With the Crank-Nicholson time stepping method, the algebraic system of equations at each time step is solved with the conjugate gradient method, preconditioned with hierarchical interpolative factorization. Stiffness matrices arising in the discretization of parabolic equations typically have large condition numbers, and therefore preconditioning becomes essential, especially for large time steps. We propose to use the hierarchical interpolative factorization as the preconditioning for the co…
Coupling-Robust Accuracy in Multiphysics Physics Informed Neural Networks via Kronecker-Preconditioned Optimization
Dept. of Control and Instrumentation Engineering, Korea University, Sejong, South Korea（控制与仪器工程系，韩国大学，世宗，韩国）；BK21 FOUR Smart Mobility Education and Research Team, Korea University, Sejong, South Korea（BK21 FOUR智能交通教育与研究团队，韩国大学，世宗，韩国）
In this note we exploit polynomial preconditioners for the Conjugate Gradient method to solve large symmetric positive definite linear systems in a parallel environment. We put in connection a specialized Newton method to solve the matrix equation X^{-1} = A and the Chebyshev polynomials for preconditioning. We propose a simple modification of one parameter which avoids clustering of extremal eigenvalues in order to speed-up convergence. We provide results on very large matrices (up to 8 billion unknowns) in a parallel environment showing the efficiency of the proposed class of preconditioners…
In this paper we consider multiple saddle point problems with block tridiagonal Hessian in a Hilbert space setting. Well-posedness and the related issue of preconditioning are discussed. We give a characterization of all block structured norms which ensure well-posedness of multiple saddle point problems as a helpful tool for constructing block diagonal preconditioners. We subsequently apply our findings to a general class of PDE-constrained optimal control problems containing a regularization parameter $α$ and derive $α$-robust preconditioners for the corresponding optimality systems. Finally…
The mass matrix for Gauss-Lobatto grid points is usually approximated by Gauss-Lobatto quadrature because this leads to a diagonal matrix that is easy to invert. The exact mass matrix and its inverse are full. We show that the exact mass matrix \emph{and} its inverse differ from the approximate diagonal ones by a simple rank-1 update (outer product). They can thus be applied to an arbitrary vector in $O(N)$ operations instead of $O(N^2)$.
This note presents a summary and review of various conditions and characterizations for matrix stability (in particular diagonal matrix stability) and matrix stabilizability.
