The need to know a few singular triplets associated with the largest singular values of third-order tensors arises in data compression and extraction. This paper describes a new method for their computation using the t-product. Methods for determining a couple of singular triplets associated with the smallest singular values also are presented. The proposed methods generalize available restarted Lanczos bidiagonalization methods for computing a few of the largest or smallest singular triplets of a matrix. The methods of this paper use Ritz and harmonic Ritz lateral slices to determine accurate approximations of the largest and smallest singular triplets, respectively. Computed examples show applications to data compression and face recognition.
A Refined Harmonic Lanczos Bidiagonalization Method and an Implicitly Restarted Algorithm for Computing the Smallest Singular Triplets of Large Matrices
Tsinghua University(清华大学);Dalian University of Technology(大连理工大学)
Split Bregman Isotropic and Anisotropic Image Deblurring with Kronecker Product Sum Approximations using Single Precision Enlarged-GKB or RSVD Algorithms to provide low rank truncated SVDs
Fast computation of the principal components of genotype matrices in Julia
Massachusetts Institute of Technology(麻省理工学院);Computer Science and Artificial Intelligence Laboratory, Massachusetts Institute of Technology(麻省理工学院计算机科学与人工智能实验室);Department of Mathematics and Computer Science and Artificial Intelligence Laboratory, Massachusetts Institute of Technology(麻省理工学院数学与计算机科学系及计算机科学与人工智能实验室)
The oriented singular value decomposition (O-SVD) proposed by Zeng and Ng provides a hybrid approach to the t-product based third-order tensor singular value decomposition with the transform matrix being a factor matrix of the higher order singular value decomposition. Continuing along this vein, this paper explores realizing the O-SVD more efficiently by the tensor-train rank-1 decomposition and gives a truncated O-SVD. Motivated by the success of probabilistic algorithms, we develop a randomized version of the O-SVD and present its detailed error analysis. The new algorithm has advantages in…
Gauss-Legendre quadrature and the trapezoidal rule are powerful tools for numerical integration of analytic functions. For nearly singular problems, however, these standard methods become unacceptably slow. We discuss and generalize some existing methods for improving on these schemes when the location of the nearby singularity is known. We conclude with an application to some nearly singular surface integrals of viscous flow.
Photoacoustic tomography (PAT) is a novel and promising technology in hybrid medical imaging that involves generating acoustic waves in the object of interest by stimulating electromagnetic energy. The acoustic wave is measured outside the object. One of the key mathematical problems in PAT is the reconstruction of the initial function that contains diagnostic information from the solution of the wave equation on the surface of the acoustic transducers. Herein, we propose a wave forward operator that assigns an initial function to obtain the solution of the wave equation on a unit sphere. Unde…
A flexible transform-based tensor product named $\star_{\rm{QT}}$-product for $L$th-order ($L\geq 3$) quaternion tensors is proposed. Based on the $\star_{\rm{QT}}$-product, we define the corresponding singular value decomposition named TQt-SVD and the rank named TQt-rank of the $L$th-order ($L\geq 3$) quaternion tensor. Furthermore, with orthogonal quaternion transformations, the TQt-SVD can provide the best TQt-rank-$s$ approximation of any $L$th-order ($L\geq 3$) quaternion tensor. In the experiments, we have verified the effectiveness of the proposed TQt-SVD in the application of the best …
Two harmonic extraction based Jacobi--Davidson (JD) type algorithms are proposed to compute a partial generalized singular value decomposition (GSVD) of a large regular matrix pair. They are called cross product-free (CPF) and inverse-free (IF) harmonic JDGSVD algorithms, abbreviated as CPF-HJDGSVD and IF-HJDGSVD, respectively. Compared with the standard extraction based JDGSVD algorithm, the harmonic extraction based algorithms converge more regularly and suit better for computing GSVD components corresponding to interior generalized singular values. Thick-restart CPF-HJDGSVD and IF-HJDGSVD a…
This paper presents a randomized quaternion singular value decomposition (QSVD) algorithm for low-rank matrix approximation problems, which are widely used in color face recognition, video compression, and signal processing problems. With quaternion normal distribution based random sampling, the randomized QSVD algorithm projects a high-dimensional data to a low-dimensional subspace and then identifies an approximate range subspace of the quaternion matrix. The key statistical properties of quaternion Wishart distribution are proposed and used to perform the approximation error analysis of the…
In this paper, we propose a computationally efficient iterative algorithm for proper orthogonal decomposition (POD) using random sampling based techniques. In this algorithm, additional rows and columns are sampled and a merging technique is used to update the dominant POD modes in each iteration. We derive bounds for the spectral norm of the error introduced by a series of merging operations. We use an existing theorem to get an approximate measure of the quality of subspaces obtained on convergence of the iteration. Results on various datasets indicate that the POD modes and/or the subspaces…
In singular value decomposition (SVD) of a complex matrix A, the singular vectors or the eigenvectors of AA† and A†A are unique up to complex phase factors. Thus, the two unitary matrices in SVD are unique up to diagonal matrices of phase factors, the phase-factor matrices. Also, the product of these two phase-factor matrices, or the product of phase factors of the corresponding singular vectors with the same singular value, is unique. In the Schmidt decomposition, a phase-factor matrix is a phase rotation operator acting on a subsystem alone. We summarize here three simple steps to consistent…
Truncated singular value decomposition is a reduced version of the singular value decomposition in which only a few largest singular values are retained. This paper presents a novel perturbation analysis for the truncated singular value decomposition for real matrices. First, we describe perturbation expansions for the singular value truncation of order $r$. We extend perturbation results for the singular subspace decomposition to derive the first-order perturbation expansion of the truncated operator about a matrix with rank greater than or equal to $r$. Observing that the first-order expansi…