高维高斯随机矩阵的矩界:应用与限制
Moment bounds for condition numbers and singular values of high-dimensional Gaussian random matrices: Applications and limitations
AI总结:
本文研究了高维高斯随机矩阵的矩界,推导了条件数和奇异值的矩界,并应用于高维回归和协方差估计,同时指出这些界无法扩展到更广的子高斯随机矩阵类。
摘要:
Gram矩阵的谱性质在回归和协方差估计中统计估计量的高维渐近分析中居于核心地位。这些性质反过来依赖于高斯随机矩阵的极值奇异值和条件数。对于许多应用,需要这些量的精确正负矩界来控制预期预测风险及相关性能指标。尽管已有大量工作提供了高斯随机矩阵极值奇异值的集中和尾部界,但这些结果无法直接得到此类分析所需的矩界。受此差距的启发,我们建立了非渐近的矩界,用于任意正矩的最大的奇异值和任意负矩的最小奇异值,以及高维高斯随机矩阵条件数的任意正矩的统一界。我们通过将这些界应用于推导高维回归和协方差估计中的显式风险保证,以及获得求解Gram线性系统时梯度下降的均值迭代复杂度的界。最后,我们展示了正条件数矩界和负最小奇异值矩界不能一般扩展到更广泛的子高斯随机矩阵类别的反例。
英文摘要:
Spectral properties of Gram matrices are central to high dimensional asymptotic analyses of statistical estimators in regression and covariance estimation. These properties, in turn, depend critically on the extreme singular values and condition numbers of Gaussian random matrices. For many applications, sharp positive and negative moment bounds for these quantities are required to control expected prediction risk and related performance metrics. Although extensive work provides concentration and tail bounds for extreme singular values of Gaussian random matrices, these results do not readily yield the moment bounds needed in such analyses. Motivated by this gap, we establish non asymptotic moment bounds for arbitrary positive moments of the largest singular value and arbitrary negative moments of the smallest singular value, and uniform bounds for arbitrary positive moments of the condition number of high dimensional Gaussian random matrices. We demonstrate the utility of these bounds by applying them to derive explicit risk guarantees in high dimensional regression and covariance estimation, as well as to obtain bounds on the mean iteration complexity of gradient descent for solving Gram linear systems. Finally, we present counterexamples demonstrating that the positive condition number moment bounds and negative smallest singular value moment bounds cannot, in general, be extended to the broader class of sub Gaussian random matrices.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。