快速评估谱信号检测阈值和Stieltjes变换
Rapid evaluation of the spectral signal detection threshold and Stieltjes transform
AI总结:
本文提出了一种快速算法,用于在大数据矩阵极限下评估谱信号检测阈值,并设计了新的算法来计算谱分布的Stieltjes变换,以提高谱去噪方法的参数估计精度。
摘要:
准确检测信号成分是统计应用中低信噪比下的常见挑战,特别是在异方差噪声环境下尤为困难。在某些信号加噪声模型中,如经典主成分协方差模型及其变体,对于各向同性噪声,在大数据矩阵极限下存在闭合公式计算谱信号检测阈值(最大的样本特征值仅归因于噪声)。然而,更一般的噪声模型目前缺乏可以证明快速且准确数值评估阈值的方法。本文提出了一种快速算法用于在大数据矩阵极限下评估谱信号检测阈值。我们考虑具有可分离方差轮廓(其方差矩阵为秩一)的噪声矩阵,因为这些在应用中经常出现。该解决方案基于嵌套应用牛顿法。我们还设计了新的算法用于在超过阈值的实数值上计算谱分布的Stieltjes变换。Stieltjes变换在此域内是谱去噪方法参数估计的关键量。两种算法的正确性均通过详细分析Stieltjes变换的主方程得到证明,其性能在数值实验中得到展示。
英文摘要:
Accurate detection of signal components is a frequently-encountered challenge in statistical applications with low signal-to-noise ratio. This problem is particularly challenging in settings with heteroscedastic noise. In certain signal-plus-noise models of data, such as the classical spiked covariance model and its variants, there are closed formulas for the spectral signal detection threshold (the largest sample eigenvalue attributable solely to noise) for isotropic noise in the limit of infinitely large data matrices. However, more general noise models currently lack provably fast and accurate methods for numerically evaluating the threshold. In this work, we introduce a rapid algorithm for evaluating the spectral signal detection threshold in the limit of infinitely large data matrices. We consider noise matrices with a separable variance profile (whose variance matrix is rank one), as these arise often in applications. The solution is based on nested applications of Newton's method. We also devise a new algorithm for evaluating the Stieltjes transform of the spectral distribution at real values exceeding the threshold. The Stieltjes transform on this domain is known to be a key quantity in parameter estimation for spectral denoising methods. The correctness of both algorithms is proven from a detailed analysis of the master equations characterizing the Stieltjes transform, and their performance is demonstrated in numerical experiments.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。