对角衰减：主成分分析的一种有限样本修正
Diagonal Attenuation: A Finite-Sample Correction for PCA
- University of Toronto（多伦多大学）
- MBZUAI（穆罕默德·本·扎耶德人工智能大学）
机构由 AI 辅助整理，请以论文原文为准。
AI总结：
针对有限数据估计协方差导致PCA偏离总体目标的问题，提出对角衰减方法，通过保留样本交叉协方差并降低坐标方向样本方差来减少旋转，在多种数据上优于现有方法。
AI中文摘要：
主成分分析（PCA）在协方差矩阵由有限数据估计时，可能会偏离其总体目标。我们引入对角衰减，该方法在降低坐标方向样本方差的同时保留样本交叉协方差。通过将线性全输出重建损失对随机输入掩码取平均，可以精确揭示该方法；直接研究该修正可将其扩展到掩码所能达到的范围之外。我们分离了保留与省略的总体方向之间随机耦合中由样本方差误差贡献的部分，并展示了衰减如何减少由此产生的旋转。在平衡边际方差下，我们推导出一个显式的期望风险定理，该定理对所有足够大的有限样本在衰减路径上一致成立，并获得了渐近风险最小化的强度。对于一般协方差，我们刻画了衰减何时使总体PCA子空间保持不变，并给出了一个风险定理，该定理还考虑了特征间隙的变化以及目标移动时的总体代价。模拟跟踪了这一权衡从精确保持回到PCA的过程。在局部图像块、语音频谱和智能手机加速度数据上，掩码导出和直接衰减方法在两种拟合样本预算下均改善了PCA，且在每一个数据-预算组合中，其中一种方法在七种方法中具有最大的平均增益。完整路径在63%–95%的子样本上选择了超出掩码导出边界的强度。
英文摘要：
Principal component analysis (PCA) can rotate away from its population target when a covariance matrix is estimated from limited data. We introduce diagonal attenuation, which preserves sample cross-covariances while reducing coordinatewise sample variances. The method is revealed exactly by averaging a linear full-output reconstruction loss over random input masks; studying the correction directly extends it beyond the range attainable by masking. We isolate the part of the random coupling between retained and omitted population directions that is contributed by sample-variance errors, and show how attenuation can reduce the resulting rotation. Under balanced marginal variances, we derive an explicit expected-risk theorem, uniform over the attenuation path for all sufficiently large finite samples, and obtain the asymptotically risk-minimizing strength. For general covariances, we characterize when attenuation leaves the population PCA subspace unchanged and give a risk theorem that also accounts for changing eigengaps and the population cost when the target moves. Simulations track this tradeoff from exact preservation back to PCA. Across local image patches, speech spectra, and smartphone acceleration, both mask-derived and direct attenuation improve PCA under two fitting-sample budgets, and one of them has the largest mean gain among seven methods in every data--budget cell. The full path selects strengths beyond the mask-derived boundary on $63\%$--$95\%$ of the subsamples.
