SuperPCA：子空间分析与高维PCA的高效算法
SuperPCA: subspace analysis and an efficient algorithm for high-dimensional PCA
- University of Oxford（牛津大学）
- University of Groningen（格罗宁根大学）
- EPFL（洛桑联邦理工学院）
机构由 AI 辅助整理，请以论文原文为准。
AI总结：
针对尖峰协方差模型，发现样本协方差矩阵主要特征向量张成的子空间比单个特征向量更早包含信号信息，据此提出SuperPCA算法，通过子采样坐标高效估计高维多信号主成分，同等测量次数下精度提升10倍。
AI中文摘要：
主成分分析（PCA）是一种在许多应用中降低数据维度的基本工具。PCA通过计算样本协方差矩阵的特征向量，找到包含数据大部分变异性的少数信号方向。在这项工作中，我们关注尖峰协方差模型，其中数据向量由少数正交信号加上各向同性高斯噪声定义，我们的目标是估计一个或多个主要信号。我们的主要理论发现是，样本协方差矩阵的几个主要特征向量所张成的子空间，在单个特征向量收敛到总体主成分之前很久，就包含了关于所需信号的重要信息。为了证明这一点，我们利用奇异向量的扰动理论，推导了期望总体信号所张成的子空间与从样本中获得的子空间之间夹角的后验界。这导致了一种新算法，SuperPCA（SUbsPace subsamplER PCA），它利用样本协方差矩阵的近似特征空间，在高维多信号设置中比经典PCA更高效、更准确地找到主要信号。SuperPCA仅利用数据的一小部分子采样坐标，这可以在数据采集成本上带来巨大节省，尤其是当信号近似稀疏时。在相同测量次数下，与经典PCA方法相比，SuperPCA可以提供10倍的精度提升。
英文摘要：
Principal component analysis (PCA) is a fundamental tool to reduce the dimensionality of the data in many applications. PCA finds a few signal directions that contain most of the variability of the data by computing the eigenvectors of the sample covariance matrix. In this work, we focus on the spiked covariance model, in which the data vectors are defined by a few orthogonal signals plus an isotropic Gaussian noise, and our goal is to estimate one or more of the leading signals. Our main theoretical finding is that the subspace spanned by several leading eigenvectors of the sample covariance matrix contains significant information about the desired signals long before the individual eigenvectors converge to the population principal components. To prove this, we derive a posteriori bounds for the angle between the subspace spanned by the desired population signals and the subspace obtained from the sample using perturbation theory for singular vectors. This leads to a new algorithm, SuperPCA (SUbsPace subsamplER PCA), which capitalizes on an approximate eigenspace of the sample covariance matrix to find the leading signals far more efficiently and accurately than classical PCA in the high-dimensional, multi-signal setting. SuperPCA exploits only a small number of subsampled coordinates of the data, which can lead to tremendous savings in data acquisition cost, especially when the signals are approximately sparse. For the same number of measurements, SuperPCA can offer a factor $10$ improvement in accuracy compared to the classical PCA method.
