arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2210.04488math.STstat.TH
收藏

半圆极限下的最优特征值收缩

Optimal Eigenvalue Shrinkage in the Semicircle Limit

David L. Donoho, Michael J. Feldman

AI总结:

本文研究了非比例增长渐近框架下的尖峰协方差模型,针对15种损失函数推导出封闭形式的最优特征值收缩与阈值化规则,并基于spiked Wigner模型提出统一框架实现渐近最优性。

摘要:

现代数据集正趋向于越来越高的维度。作为回应,近期关于协方差估计的理论研究通常采用比例增长渐近框架,即样本量$n$和维度$p$相当,且$n, p \rightarrow \infty$及$\gamma_n = p/n \rightarrow \gamma > 0$。然而,许多数据集——可能是大多数——的行数和列数差异很大。我们转而考虑非比例增长渐近框架,其中$n, p \rightarrow \infty$且$\gamma_n \rightarrow 0$或$\gamma_n \rightarrow \infty$。任一非比例极限都会引发先前比例和固定$p$分析中未曾见过的新现象。我们研究了尖峰协方差模型,其理论协方差是单位矩阵的低秩扰动。对于15种不同的损失函数,我们以封闭形式展示了新的最优收缩和阈值化规则。我们的最优方法需要广泛的特征值收缩,并且与标准经验协方差估计器相比,提供了显著的性能优势。实践者可能会问,应将其数据视为产生于比例框架还是非比例框架(并应用相应的方法)。令人欣慰的是,可以保持框架不可知:一套统一的封闭形式收缩规则(仅取决于给定数据的宽高比$\gamma_n$)在两种框架下均提供完全的渐近最优性。我们所探索现象的核心是spiked Wigner模型,其中低秩矩阵受到对称噪声的扰动。利用与$\gamma_n \rightarrow 0$时尖峰协方差模型的联系,我们推导出了用于估计低秩分量的最优特征值收缩规则,这具有独立且基础的研究价值。

英文摘要:

Modern datasets are trending towards ever higher dimension. In response, recent theoretical studies of covariance estimation often assume the proportional-growth asymptotic framework, where the sample size $n$ and dimension $p$ are comparable, with $n, p \rightarrow \infty $ and $γ_n = p/n \rightarrow γ> 0$. Yet, many datasets -- perhaps most -- have very different numbers of rows and columns. We consider instead the disproportional-growth asymptotic framework, where $n, p \rightarrow \infty$ and $γ_n \rightarrow 0$ or $γ_n \rightarrow \infty$. Either disproportional limit induces novel behavior unseen within previous proportional and fixed-$p$ analyses. We study the spiked covariance model, with theoretical covariance a low-rank perturbation of the identity. For each of 15 different loss functions, we exhibit in closed form new optimal shrinkage and thresholding rules. Our optimal procedures demand extensive eigenvalue shrinkage and offer substantial performance benefits over the standard empirical covariance estimator. Practitioners may ask whether to view their data as arising within (and apply the procedures of) the proportional or disproportional frameworks. Conveniently, it is possible to remain {\it framework agnostic}: one unified set of closed-form shrinkage rules (depending only on the aspect ratio $γ_n$ of the given data) offers full asymptotic optimality under either framework. At the heart of the phenomena we explore is the spiked Wigner model, in which a low-rank matrix is perturbed by symmetric noise. Exploiting a connection to the spiked covariance model as $γ_n \rightarrow 0$, we derive optimal eigenvalue shrinkage rules for estimation of the low-rank component, of independent and fundamental interest.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑