arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1409.3301stat.MEmath.STstat.TH
收藏

估计大精度矩阵的偏相关筛选及其在分类中的应用

Partial Correlation Screening for Estimating Large Precision Matrices, with Applications to Classification

Shiqiong Huang, Jiashun Jin, Zhigang Yao

摘要:

我们提出了部分相关筛选(PCS)作为一个新的逐行的方法来估计一个大的精度矩阵$Ω$。为了估计$Ω$的第$i$行,$1 \leq i \leq p$,PCS使用“筛选”步骤和“清除”步骤。在筛选步骤中,PCS使用逐阶段算法招募索引的(小)子集,其中在每个阶段中,算法通过添加与$i$具有最大(在幅度上)经验偏相关性的索引$j$来更新所招募索引的集合。在清理步骤中,PCS重新调查所有被招募的索引并使用它们来重构$Ω$的第$i$行。PCS在计算上是有效的并且在存储器中是适度的用途:为了估计$Ω$的行,它仅需要经验协方差阵的几行(顺序确定)。这使得PCS能够执行大精度矩阵(例如,$p=10K$),并为估计更大的精度矩阵打开了大门。我们使用PCS进行分类。更高的批评保持(HCT)是一个最近的分类器,享有最优性,但在实践中充分利用其潜力,需要一个很好的估计精度矩阵$Ω$。将HCT与估计$Ω$的任何方法相结合给出了新的分类器:示例包括HCT-PCS和HCT-glasso。我们已经将HCT-PCS应用于两个大的微阵列数据集($p = 8K$和$10K$)进行分类,其中它不仅显著优于HCT-glasso,而且与支持向量机(SVM)和随机森林(RF)竞争。结果表明,PCS给出了更有用的估计比glasso的$Ω$。我们建立了一个一般的理论框架,并表明,在一个广泛的背景下,PCS完全恢复的支持$Ω$和HCT-PCS产生最佳的分类行为。我们的证明揭示了阶段明智的程序的行为有趣的光。

英文摘要:

We propose Partial Correlation Screening (PCS) as a new row-by-row approach to estimating a large precision matrix $Ω$. To estimate the $i$-th row of $Ω$, $1 \leq i \leq p$, PCS uses a Screen step and a Clean step. In the Screen step, PCS recruits a (small) subset of indices using a stage-wise algorithm, where in each stage, the algorithm updates the set of recruited indices by adding the index $j$ that has the largest (in magnitude) empirical partial correlation with $i$. In the Clean step, PCS re-investigates all recruited indices and use them to reconstruct the $i$-th row of $Ω$. PCS is computationally efficient and modest in memory use: to estimate a row of $Ω$, it only needs a few rows (determined sequentially) of the empirical covariance matrix. This enables PCS to execute the estimation of a large precision matrix (e.g., $p=10K$) in a few minutes, and open doors to estimating much larger precision matrices. We use PCS for classification. Higher Criticism Thresholding (HCT) is a recent classifier that enjoys optimality, but to exploit its full potential in practice, one needs a good estimate of the precision matrix $Ω$. Combining HCT with any approach to estimating $Ω$ gives a new classifier: examples include HCT-PCS and HCT-glasso. We have applied HCT-PCS to two large microarray data sets ($p = 8K$ and $10K$) for classification, where it not only significantly outperforms HCT-glasso, but also is competitive to the Support Vector Machine (SVM) and Random Forest (RF). The results suggest that PCS gives more useful estimates of $Ω$ than the glasso. We set up a general theoretical framework and show that in a broad context, PCS fully recovers the support of $Ω$ and HCT-PCS yields optimal classification behavior. Our proofs shed interesting light on the behavior of stage-wise procedures.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑