arXivDaily arXiv每日学术速递 周一至周五更新
看起来今天可以划水了
arXiv 1609.00883math.STstat.TH
收藏

检测大协方差阵中的稀疏弱尖峰信号

Detecting Rare and Weak Spikes in Large Covariance Matrices

Zheng Tracy Ke

摘要:

给定$p$维高斯向量$X_i \stackrel{iid}{\sim} N(0, Σ)$、$1 \leq i \leq n$,其中$p \geq n$,我们感兴趣的是测试零假设,其中$Σ= I_p$相对于备择假设,其中$Σ$的所有特征值都是$1$,除了它们中的$r$大于$1$(即,尖峰特征值)。我们考虑一个罕见/弱设置,其中尖峰是稀疏的(即,$1 \ll r \ll p$)和单独弱(即,每个尖峰特征值仅略大于$1$),并发现相变:校准尖峰稀疏度和强度的二维相空间划分为不可能区域和可能区域。在不可能区域中,所有测试都(渐近地)无力将备选项与空值分离。在可能性区域中,存在具有(渐近)全功效的检验。我们考虑了CuSum检验、基于迹的检验、基于特征值的Higher Criticism检验和Tracy-Widom检验(Johnstone 2001),并证明了前两个检验在可能性区域中具有渐近全功效。为了从不同的角度使用我们的结果,我们推导出(a)经验本征值和(b)经验本征值的累积和的新界限,两者都是在备择假设下。(a)部分与Baik、Ben-Arous和Peche(2005)的结果相关,但设置和结果都不同。该研究需要对测试问题的$L^1$ -距离进行仔细的分析,并需要精细的随机矩阵理论。我们的技术设计包括(a)高斯代理模型,(b)Le Cam的实验比较,以及(c)经验特征值的大偏差范围。

英文摘要:

Given $p$-dimensional Gaussian vectors $X_i \stackrel{iid}{\sim} N(0, Σ)$, $1 \leq i \leq n$, where $p \geq n$, we are interested in testing a null hypothesis where $Σ= I_p$ against an alternative hypothesis where all eigenvalues of $Σ$ are $1$, except for $r$ of them are larger than $1$ (i.e., spiked eigenvalues). We consider a Rare/Weak setting where the spikes are sparse (i.e., $1 \ll r \ll p$) and individually weak (i.e., each spiked eigenvalue is only slightly larger than $1$), and discover a phase transition: the two-dimensional phase space that calibrates the spike sparsity and strengths partitions into the Region of Impossibility and the Region of Possibility. In Region of Impossibility, all tests are (asymptotically) powerless in separating the alternative from the null. In Region of Possibility, there are tests that have (asymptotically) full power. We consider a CuSum test, a trace-based test, an eigenvalue-based Higher Criticism test, and a Tracy-Widom test (Johnstone 2001), and show that the first two tests have asymptotically full power in Region of Possibility. To use our results from a different angle, we derive new bounds for (a) empirical eigenvalues, and (b) cumulative sums of the empirical eigenvalues, both under the alternative hypothesis. Part (a) is related to those in Baik, Ben-Arous and Peche (2005), but both the settings and results are different. The study requires careful analysis of the $L^1$-distance of our testing problem and delicate Radom Matrix Theory. Our technical devises include (a) a Gaussian proxy model, (b) Le Cam's comparison of experiments, and (c) large deviation bounds on empirical eigenvalues.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑