arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2009.07542math.NAcs.NAmath.STstat.TH
收藏

截断奇异值分解的扰动展开和误差界

Perturbation expansions and error bounds for the truncated singular value decomposition

Trung Vu, Evgenia Chunikhina, Raviv Raich

摘要:

截断奇异值分解是奇异值分解的简化版本,其中仅保留少数最大的奇异值。提出了一种新的实矩阵截断奇异值分解的扰动分析方法。首先,我们描述的奇异值截断阶$r$的扰动展开。我们推广了奇异子空间分解的扰动结果,导出了截断算子关于秩大于或等于$r$的矩阵的一阶扰动展开式。当矩阵具有精确秩$r$时,一阶展开可以大大简化,进一步证明了奇异值截断允许关于秩- $r$矩阵的简单二阶扰动展开.其次,我们引入了扰动秩- $r$矩阵的截断奇异值分解的线性逼近的第一已知误差界。我们的界只依赖于未扰动矩阵的最小奇异值和扰动矩阵的范数。有趣的是,虽然奇异子空间是非常敏感的加性噪声,新建立的误差界普遍适用于任意大小的扰动。最后,我们展示了应用我们的结果与TSVD为基础的矩阵去噪解决方案的均方误差的分析。

英文摘要:

Truncated singular value decomposition is a reduced version of the singular value decomposition in which only a few largest singular values are retained. This paper presents a novel perturbation analysis for the truncated singular value decomposition for real matrices. First, we describe perturbation expansions for the singular value truncation of order $r$. We extend perturbation results for the singular subspace decomposition to derive the first-order perturbation expansion of the truncated operator about a matrix with rank greater than or equal to $r$. Observing that the first-order expansion can be greatly simplified when the matrix has exact rank $r$, we further show that the singular value truncation admits a simple second-order perturbation expansion about a rank-$r$ matrix. Second, we introduce the first-known error bound on the linear approximation of the truncated singular value decomposition of a perturbed rank-$r$ matrix. Our bound only depends on the least singular value of the unperturbed matrix and the norm of the perturbation matrix. Intriguingly, while the singular subspaces are known to be extremely sensitive to additive noises, the newly established error bound holds universally for perturbations with arbitrary magnitude. Finally, we demonstrate an application of our results to the analysis of the mean squared error associated with the TSVD-based matrix denoising solution.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑