arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1702.06435cs.ITmath.ITstat.ML
收藏

高维非凸估计谱估计的相变

Phase Transitions of Spectral Initialization for High-Dimensional Nonconvex Estimation

Yue M. Lu, Gen Li

摘要:

我们研究了一个频谱初始化方法,在最近的工作中发挥了关键作用,估计信号在非凸设置。先前对该方法的分析集中在相位恢复问题上,并且仅提供性能界限。在本文中,我们考虑任意广义线性传感模型,并提出了一个精确的渐近特性的性能的方法在高维极限。我们的分析还揭示了一个相变现象,取决于样本数和信号维数之间的比率。当比值低于最小阈值时,谱方法给出的估计并不比从超球面上的均匀分布中得出的随机猜测更好,因此不携带任何信息;高于最大阈值时,估计变得越来越与目标信号一致。该方法的计算复杂性,如通过谱隙测量的,在两个阶段中也明显不同。工作的例子和数值结果来说明和验证的分析预测。特别是,模拟表明,我们的渐近公式提供准确的预测,即使在中等信号尺寸的频谱方法的实际性能。

英文摘要:

We study a spectral initialization method that serves a key role in recent work on estimating signals in nonconvex settings. Previous analysis of this method focuses on the phase retrieval problem and provides only performance bounds. In this paper, we consider arbitrary generalized linear sensing models and present a precise asymptotic characterization of the performance of the method in the high-dimensional limit. Our analysis also reveals a phase transition phenomenon that depends on the ratio between the number of samples and the signal dimension. When the ratio is below a minimum threshold, the estimates given by the spectral method are no better than random guesses drawn from a uniform distribution on the hypersphere, thus carrying no information; above a maximum threshold, the estimates become increasingly aligned with the target signal. The computational complexity of the method, as measured by the spectral gap, is also markedly different in the two phases. Worked examples and numerical results are provided to illustrate and verify the analytical predictions. In particular, simulations show that our asymptotic formulas provide accurate predictions for the actual performance of the spectral method even at moderate signal dimensions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑