arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv math/0609418math.STstat.TH
收藏

基于随机矩阵理论的高维协方差阵谱估计

Spectrum estimation for large dimensional covariance matrices using random matrix theory

Noureddine El Karoui

摘要:

由样本协方差阵估计总体协方差矩阵的特征值是多元统计中的一个基本问题,协方差阵的特征值在许多广泛应用的技术中起着关键作用,特别是在主成分分析(PCA)中。在许多现代数据分析问题中,统计学家面临着大型数据集,其中样本量n与变量数p具有相同的数量级。随机矩阵理论预测,在这种情况下,样本协方差阵的特征值不是总体协方差特征值的良好估计。我们建议使用随机矩阵理论中的一个基本结果,Marcenko-Pastur方程,来更好地估计高维协方差阵的特征值。Marcenko-Pastur方程在非常广泛的普遍性和弱假设下成立。我们得到的估计量可以看作是以非线性方式“收缩”样本协方差阵的特征值来估计总体特征值。受随机矩阵理论思想的启发,我们还建议在考虑高维向量的估计时改变观点:我们不试图直接估计向量,而是用描述它们的概率测度。我们认为这是一个理论上更富有成效的方式来思考统计这些问题。我们的估计器在扩展模拟中给出了快速和良好或非常好的结果。我们的算法方法是基于凸优化。我们还表明,所提出的估计是一致的。

英文摘要:

Estimating the eigenvalues of a population covariance matrix from a sample covariance matrix is a problem of fundamental importance in multivariate statistics; the eigenvalues of covariance matrices play a key role in many widely techniques, in particular in Principal Component Analysis (PCA). In many modern data analysis problems, statisticians are faced with large datasets where the sample size, n, is of the same order of magnitude as the number of variables p. Random matrix theory predicts that in this context, the eigenvalues of the sample covariance matrix are not good estimators of the eigenvalues of the population covariance. We propose to use a fundamental result in random matrix theory, the Marcenko-Pastur equation, to better estimate the eigenvalues of large dimensional covariance matrices. The Marcenko-Pastur equation holds in very wide generality and under weak assumptions. The estimator we obtain can be thought of as "shrinking" in a non linear fashion the eigenvalues of the sample covariance matrix to estimate the population eigenvalue. Inspired by ideas of random matrix theory, we also suggest a change of point of view when thinking about estimation of high-dimensional vectors: we do not try to estimate directly the vectors but rather a probability measure that describes them. We think this is a theoretically more fruitful way to think statistically about these problems. Our estimator gives fast and good or very good results in extended simulations. Our algorithmic approach is based on convex optimization. We also show that the proposed estimator is consistent.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑