arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2107.01352math-phmath.MPmath.STq-fin.PMstat.TH
收藏

Cleaning large-dimensional covariance matrices for correlated samples

Zdzislaw Burda, Andrzej Jarosz

英文摘要:

We elucidate the problem of estimating large-dimensional covariance matrices in the presence of correlations between samples. To this end, we generalize the Marcenko-Pastur equation and the Ledoit-Peche shrinkage estimator using methods of random matrix theory and free probability. We develop an efficient algorithm that implements the corresponding analytic formulas, based on the Ledoit-Wolf kernel estimation technique. We also provide an associated open-source Python library, called "shrinkage", with a user-friendly API to assist in practical tasks of estimation of large covariance matrices. We present an example of its usage for synthetic data generated according to exponentially-decaying auto-correlations.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑