arXivDaily arXiv每日学术速递 周一至周五更新
看起来今天可以划水了
arXiv 2008.07972math.NAcs.NAmath.OCstat.ML
收藏

秩有上界的稳健主成分分析快速算法

Fast algorithms for robust principal component analysis with an upper bound on the rank

Ningyu Sha, Lei Shi, Ming Yan

摘要:

鲁棒主成分分析(RPCA)将数据矩阵分解为低秩部分和稀疏部分。主要有两种类型的算法RPCA。第一种算法对矩阵的奇异值应用正则化项,以获得低秩矩阵。然而,对于大型矩阵,计算奇异值可能非常昂贵。第二类算法将低秩矩阵替换为两个小矩阵的乘法。它们比第一种更快,因为不需要奇异值分解(SVD)。然而,低秩矩阵的秩是需要的,并且需要精确的秩估计以获得合理的解。在本文中,我们提出的算法,结合这两种类型。我们提出的算法要求小矩阵的秩和SVD的上界。首先,它们比第一种更快,因为SVD在小矩阵上的成本可以忽略不计。第二,它们比第二类型更鲁棒,因为需要秩的上界而不是确切的秩。此外,我们应用高斯-牛顿法,以提高我们的算法的速度。数值实验表明,我们提出的算法的性能更好。

英文摘要:

The robust principal component analysis (RPCA) decomposes a data matrix into a low-rank part and a sparse part. There are mainly two types of algorithms for RPCA. The first type of algorithm applies regularization terms on the singular values of a matrix to obtain a low-rank matrix. However, calculating singular values can be very expensive for large matrices. The second type of algorithm replaces the low-rank matrix as the multiplication of two small matrices. They are faster than the first type because no singular value decomposition (SVD) is required. However, the rank of the low-rank matrix is required, and an accurate rank estimation is needed to obtain a reasonable solution. In this paper, we propose algorithms that combine both types. Our proposed algorithms require an upper bound of the rank and SVD on small matrices. First, they are faster than the first type because the cost of SVD on small matrices is negligible. Second, they are more robust than the second type because an upper bound of the rank instead of the exact rank is required. Furthermore, we apply the Gauss-Newton method to increase the speed of our algorithms. Numerical experiments show the better performance of our proposed algorithms.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑