arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 0911.3213cs.ITmath.IT
收藏

通过配分函数梯度和信息测度的最优估计:物理力学观点

Optimum estimation via gradients of partition functions and information measures: a statistical-mechanical perspective

Neri Merhav

摘要:

为了继续最近关于高斯噪声中最小均方误差(MMSE)估计的统计-机械分析的工作,通过其与互信息的关系(I-MMSE关系),在这里,我们提出了最佳估计与某些信息度量(例如,信息密度和Fisher信息),其可以被看作是配分函数,因此可以使用统计力学技术进行分析。所提出的方法具有几个优点,最值得注意的是,其适用于一般源和信道,而不是I-MMSE关系及其仅适用于某些类别的信道(例如,加性高斯白噪声信道)。然后,我们证明了推导的条件均值估计和MMSE在几个例子。其中两个例子被证明可以推广到相当广泛的一类来源和渠道。对于这个类,所提出的方法产生一个近似的条件均值估计和MMSE公式,具有味道的一个字母的表达。我们还展示了我们的方法可以很容易地推广到不匹配的估计的情况。

英文摘要:

In continuation to a recent work on the statistical--mechanical analysis of minimum mean square error (MMSE) estimation in Gaussian noise via its relation to the mutual information (the I-MMSE relation), here we propose a simple and more direct relationship between optimum estimation and certain information measures (e.g., the information density and the Fisher information), which can be viewed as partition functions and hence are amenable to analysis using statistical--mechanical techniques. The proposed approach has several advantages, most notably, its applicability to general sources and channels, as opposed to the I-MMSE relation and its variants which hold only for certain classes of channels (e.g., additive white Gaussian noise channels). We then demonstrate the derivation of the conditional mean estimator and the MMSE in a few examples. Two of these examples turn out to be generalizable to a fairly wide class of sources and channels. For this class, the proposed approach is shown to yield an approximate conditional mean estimator and an MMSE formula that has the flavor of a single-letter expression. We also show how our approach can easily be generalized to situations of mismatched estimation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑