arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1607.01461cs.ITmath.IT
收藏

高斯噪声信道中最小平均$p$阶误差及其应用

On the Minimum Mean $p$-th Error in Gaussian Noise Channels and its Applications

Alex Dytso, Ronit Bustin, Daniela Tuninetti, Natasha Devroye, H. Vincent Poor, Shlomo Shamai

摘要:

考虑了由加性高斯白噪声污染的观测值估计任意随机向量的问题,其中代价函数取最小平均$p$次误差(MMPE).经典的最小均方误差(MMSE)是MMPE的一种特殊情况。几个界限,性质和应用的MMPE推导和讨论。最佳MMPE估计发现高斯和二进制输入分布。推导出MMPE作为输入分布、SNR和阶数$p$的函数的性质。特别是,它示出的MMPE是一个连续的函数的$p$和SNR。这些结果是可能的,鉴于插值和改变的措施界限上的MMPE。将所有SNR值{ \it above}的MMSE限制在某个值的“单交叉点性质”(SCPP)与I-MMSE关系一起是在信息论中导出逆证明的有力工具,在该值处MMSE是已知的。通过研究条件MMPE的概念,一个统一的证明(即,对于SCPP的任何$p$)。然后示出了与SCPP的互补界限,其将所有SNR值{下面的\it}的MMPE限制在某个值,在该值处MMPE是已知的。作为MMPE的第一个应用,提供了MMPE方面的条件微分熵上的界,然后产生由高斯噪声信道上的离散输入实现的互信息上的Ozarow-Wyner下界的泛化。作为第二个应用程序,MMPE示出,以改善先前的表征的相变现象,表现为,在限制的容量实现代码的长度走向无穷大,作为一个不连续的MMSE作为SNR的函数。作为最后的应用,MMPE被用来显示互信息的二阶导数的界限,收紧以前已知的界限。

英文摘要:

The problem of estimating an arbitrary random vector from its observation corrupted by additive white Gaussian noise, where the cost function is taken to be the Minimum Mean $p$-th Error (MMPE), is considered. The classical Minimum Mean Square Error (MMSE) is a special case of the MMPE. Several bounds, properties and applications of the MMPE are derived and discussed. The optimal MMPE estimator is found for Gaussian and binary input distributions. Properties of the MMPE as a function of the input distribution, SNR and order $p$ are derived. In particular, it is shown that the MMPE is a continuous function of $p$ and SNR. These results are possible in view of interpolation and change of measure bounds on the MMPE. The `Single-Crossing-Point Property' (SCPP) that bounds the MMSE for all SNR values {\it above} a certain value, at which the MMSE is known, together with the I-MMSE relationship is a powerful tool in deriving converse proofs in information theory. By studying the notion of conditional MMPE, a unifying proof (i.e., for any $p$) of the SCPP is shown. A complementary bound to the SCPP is then shown, which bounds the MMPE for all SNR values {\it below} a certain value, at which the MMPE is known. As a first application of the MMPE, a bound on the conditional differential entropy in terms of the MMPE is provided, which then yields a generalization of the Ozarow-Wyner lower bound on the mutual information achieved by a discrete input on a Gaussian noise channel. As a second application, the MMPE is shown to improve on previous characterizations of the phase transition phenomenon that manifests, in the limit as the length of the capacity achieving code goes to infinity, as a discontinuity of the MMSE as a function of SNR. As a final application, the MMPE is used to show bounds on the second derivative of mutual information, that tighten previously known bounds.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑