arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 1608.05754math.NAcs.LGcs.NA
收藏

利用谱密度快速估计近似矩阵秩

Fast estimation of approximate matrix ranks using spectral densities

University of Minnesota(明尼苏达大学);University of Melbourne(墨尔本大学)

Shashanka Ubaru, Yousef Saad, Abd-Krim Seghouane

AI总结:

本文提出两种低成本方法,利用谱密度估算大数据矩阵的近似秩,通过Chebyshev多项式和Lanczos算法进行分析,结合谱密度图定位噪声与有效特征值间隙,验证方法在典型应用中的性能。

摘要:

在许多机器学习和数据应用中,需要掌握大型数据矩阵的近似秩。本文提出两种计算成本低的技术来估算此类大矩阵的近似秩。这些技术利用物理中流行的近似谱密度,即测量矩阵在实线上特定点处特征值出现概率的密度分布。对区间积分可得到该区间内矩阵的特征值计数,因此通过精心选择的区间积分可近似得到秩。讨论了两种不同的方法来估计近似秩,一种基于Chebyshev多项式,另一种基于Lanczos算法。为了获得适当的区间,需要定位噪声对应的特征值与影响矩阵秩的特征值之间的间隙。基于谱密度图提出了一种定位此间隙并选择积分区间的办法。数值实验展示了这些技术在典型应用矩阵上的性能。

英文摘要:

In many machine learning and data related applications, it is required to have the knowledge of approximate ranks of large data matrices at hand. In this paper, we present two computationally inexpensive techniques to estimate the approximate ranks of such large matrices. These techniques exploit approximate spectral densities, popular in physics, which are probability density distributions that measure the likelihood of finding eigenvalues of the matrix at a given point on the real line. Integrating the spectral density over an interval gives the eigenvalue count of the matrix in that interval. Therefore the rank can be approximated by integrating the spectral density over a carefully selected interval. Two different approaches are discussed to estimate the approximate rank, one based on Chebyshev polynomials and the other based on the Lanczos algorithm. In order to obtain the appropriate interval, it is necessary to locate a gap between the eigenvalues that correspond to noise and the relevant eigenvalues that contribute to the matrix rank. A method for locating this gap and selecting the interval of integration is proposed based on the plot of the spectral density. Numerical experiments illustrate the performance of these techniques on matrices from typical applications.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑