Matrices can be augmented by adding additional columns such that a partitioning of the matrix in blocks of rows defines mutually orthogonal subspaces. This augmented system can then be solved efficiently by a sum of projections onto these subspaces. The equivalence to the original linear system is ensured by adding additional rows to the matrix in a specific form. The resulting solution method is known as the augmented block Cimmino method. Here this method is extended to full rank underdetermined systems and to overdetermined systems. In the latter case, rows of the matrix, not columns, must be suitably augmented. The article presents an analysis of these methods.
A matrix always has a full rank submatrix such that the rank of this matrix is equal to the rank of that submatrix. This property is one of the corner stones of the matrix rank theory. We call this property the max-full-rank-submatrix property. Tensor ranks play a crucial role in low rank tensor approximation, tensor completion and tensor recovery. However, their theory is still not matured yet. Can we set an axiom system for tensor ranks? Can we extend the max-full-rank-submatrix property to tensors? We explore these in this paper. We first propose some axioms for tensor rank functions. Then …
Block full rank pencils introduced in [Dopico et al., Local linearizations of rational matrices with application to rational approximations of nonlinear eigenvalue problems, Linear Algebra Appl., 2020] allow us to obtain local information about zeros that are not poles of rational matrices. In this paper we extend the structure of those block full rank pencils to construct linearizations of rational matrices that allow us to recover locally not only information about zeros but also about poles, whenever certain minimality conditions are satisfied. In addition, the notion of degree of a rationa…
Many applications in scientific computing and data science require the computation of a rank-revealing factorization of a large matrix. In many of these instances the classical algorithms for computing the singular value decomposition are prohibitively computationally expensive. The randomized singular value decomposition can often be helpful, but is not effective unless the numerical rank of the matrix is substantially smaller than the dimensions of the matrix. We introduce a new randomized algorithm for producing rank-revealing factorizations based on existing work by Demmel, Dumitriu and Ho…
We introduce tensor numerical techniques for solving optimal control problems constrained by elliptic operators in $\mathbb{R}^d$, $d=2,3$, with variable coefficients, which can be represented in a low rank separable form. We construct a preconditioned iterative method with an adaptive rank truncation for solving the equation for the control function, governed by a sum of the elliptic operator and its inverse $M=A + A^{-1}$, both discretized over large $n^{\otimes d}$, $d=2,3$, spatial grids. Two basic solution schemes are proposed and analyzed. In the first approach, one solves iteratively th…
Tensor numerical methods, based on the rank-structured tensor representation of $d$-variate functions and operators, are designed to provide $O(dn)$ complexity of numerical calculations on $n^{\otimes d }$ grids contrary to $O(n^d)$ scaling by conventional grid-based methods. However, multiple tensor operations may lead to enormous increase in the tensor ranks (curse of ranks) of the target data, making calculation intractable. Therefore one of the most important steps in tensor calculations is the robust and efficient rank reduction procedure which should be performed many times in the course…
We approximate the solution for the time dependent Schrödinger equation (TDSE) in two steps. We first use a pseudo-spectral collocation method that uses samples of functions on rank-1 or rank-r lattice points with unitary Fourier transforms. We then get a system of ordinary differential equations in time, which we solve approximately by stepping in time using the Strang splitting method. We prove that the numerical scheme proposed converges quadratically with respect to the time step size, given that the potential is in a Korobov space with the smoothness parameter greater than $9/2$. Particul…
Historically, analysis for multiscale PDEs is largely unified while numerical schemes tend to be equation-specific. In this paper, we propose a unified framework for computing multiscale problems through random sampling. This is achieved by incorporating randomized SVD solvers and manifold learning techniques to numerically reconstruct the low-rank features of multiscale PDEs. We use multiscale radiative transfer equation and elliptic equation with rough media to showcase the application of this framework.
In this paper, a numerical method is proposed for canonical polyadic (CP) decomposition of small size tensors. The focus is primarily on decomposition of tensors that correspond to small matrix multiplications. Here, rank of the tensors is equal to the smallest number of scalar multiplications that are necessary to accomplish the matrix multiplication. The proposed method is based on a constrained Levenberg-Marquardt optimization. Numerical results indicate the rank and border ranks of tensors that correspond to multiplication of matrices of the size 2x3 and 3x2, 3x3 and 3x2, 3x3 and 3x3, and …
Many quantum algorithms for numerical linear algebra assume black-box access to a block-encoding of the matrix of interest, which is a strong assumption when the matrix is not sparse. Kernel matrices, which arise from discretizing a kernel function $k(x,x')$, have a variety of applications in mathematics and engineering. They are generally dense and full-rank. Classically, the celebrated fast multipole method performs matrix multiplication on kernel matrices of dimension $N$ in time almost linear in $N$ by using the linear algebraic framework of hierarchical matrices. In light of this success,…
In this work we introduce a reduced-rank algorithm for Gaussian process regression. Our numerical scheme converts a Gaussian process on a user-specified interval to its Karhunen-Loève expansion, the $L^2$-optimal reduced-rank representation. Numerical evaluation of the Karhunen-Loève expansion is performed once during precomputation and involves computing a numerical eigendecomposition of an integral operator whose kernel is the covariance function of the Gaussian process. The Karhunen-Loève expansion is independent of observed data and depends only on the covariance kernel and the size of the…
Low-rank approximation in the numerical modeling of the Farley-Buneman instability in ionospheric plasma
Max-Planck-Institut für Mathematik in den Naturwissenschaften（德国马克斯·普朗克自然科学数学研究所）；Institute of Numerical Mathematics of Russian Academy of Sciences（俄罗斯科学院计算数学研究所）；Lomonosov Moscow State University（莫斯科国立罗蒙诺索夫大学）；Moscow Institute of Physics and Technology（莫斯科物理技术学院）；University of Podlasie（波德拉谢大学）
