arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1612.01980cs.ITmath.IT
收藏

MAP估计的统计力学:一般解释

Statistical Mechanics of MAP Estimation: General Replica Ansatz

Ali Bereyhi, Ralf R. Müller, Hermann Schulz-Baldes

摘要:

研究了当观测向量通过加性高斯白噪声线性系统时,考虑一般失真函数的MAP估计的大系统性能。分析认为,系统矩阵是从大类旋转不变的随机矩阵。我们采取统计力学的方法,通过引入一个自旋玻璃对应的估计,并采用副本的方法进行大系统分析。在早期的副本为基础的研究,我们的分析评估相应的自旋玻璃的一般副本ananterior,并确定任何结构的副本相关矩阵的估计的渐近失真。因此,从给出的一般复型对称性出发,推导出复型对称性和具有$b$破缺步数的复型对称性破缺。我们的失真函数的一般性,让我们推导出一个更一般的形式的MAP解耦原理。基于一般的副本分析,我们表明,对于任何结构的副本相关矩阵,向量值系统的映射到一个银行的等效解耦线性系统,随后的MAP估计。在RS和RS对称破缺(RSB)假设下,进一步研究了解耦线性系统的结构。对于RSB的$b$步,解耦系统是一个加性系统,其噪声项为独立高斯随机变量与$b$相关损伤项之和。作为我们研究的一个应用,我们通过考虑$\ell_p$最小化恢复方案来研究大型压缩感知系统。我们的数值研究表明,副本对称anastrophy的$\ell_0$范数恢复未能提供一个准确的近似的均方误差的压缩率的增长,因此,RSB ansätze是必要的。

英文摘要:

The large-system performance of MAP estimation is studied considering a general distortion function when the observation vector is received through a linear system with additive white Gaussian noise. The analysis considers the system matrix to be chosen from the large class of rotationally invariant random matrices. We take a statistical mechanical approach by introducing a spin glass corresponding to the estimator, and employing the replica method for the large-system analysis. In contrast to earlier replica based studies, our analysis evaluates the general replica ansatz of the corresponding spin glass and determines the asymptotic distortion of the estimator for any structure of the replica correlation matrix. Consequently, the replica symmetric as well as the Replica Symmetry (RS) breaking ansatz with $b$ steps of breaking is deduced from the given general replica ansatz. The generality of our distortion function lets us derive a more general form of the MAP decoupling principle. Based on the general replica ansatz, we show that for any structure of the replica correlation matrix, the vector-valued system decouples into a bank of equivalent decoupled linear systems followed by MAP estimators. The structure of the decoupled linear system is further studied under both the RS and the Replica Symmetry Breaking (RSB) assumptions. For $b$ steps of RSB, the decoupled system is found to be an additive system with a noise term given as the sum of an independent Gaussian random variable with $b$ correlated impairment terms. As an application of our study, we investigate large compressive sensing systems by considering the $\ell_p$ minimization recovery schemes. Our numerical investigations show that the replica symmetric ansatz for $\ell_0$ norm recovery fails to give an accurate approximation of the mean square error as the compression rate grows, and therefore, the RSB ansätze are needed.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑