arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2104.01883cs.ITmath.ITmath.STstat.MLstat.TH
收藏

高斯噪声中条件均值估计的一个广义导数恒等式及其应用

A General Derivative Identity for the Conditional Mean Estimator in Gaussian Noise and Some Applications

Alex Dytso, H. Vincent Poor, Shlomo Shamai

摘要:

考虑信道${\bf Y}={\bf X}+ {\bf N}$,其中${\bf X}$是$n$维随机向量,${\bf N}$是具有协方差矩阵${\bf \mathsf{K}}_{\bf N}$的高斯向量.本文考虑的对象是${\bf X}$在给定${\bf Y}={\bf y}$的条件下的条件均值,即${\bf y} \to E[{\bf X}|{\bf Y}={\bf y}]$ .文献中的几个恒等式将$E[{\bf X}|{\bf Y}={\bf y}]$与条件方差、得分函数和高阶条件矩等其他量联系起来。本文的目的是提供一个统一的观点,这些身份。在本文的第一部分中,导出了条件均值的一个一般导数恒等式。具体地说,对于马尔可夫链${\bf U} \leftrightarrow {\bf X} \leftrightarrow {\bf Y}$,它表明,由${\bf \mathsf{K}}_{\bf N}^{-1} {\bf Cov} ( {\bf X}, {\bf U} | {\bf Y}={\bf y})$给出的雅可比矩阵$E[{\bf U}|{\bf Y}={\bf y}]$。在本文的第二部分中,通过对${\bf U}$的各种选择,新恒等式被用来推广许多已知的恒等式,并得到一些新的恒等式。首先,一个简单的证明Hatsel和诺尔特身份的条件方差。其次,由于Jaffer递归恒等式的一个简单的证明。第三,条件累积量和条件期望之间的一个新的连接。特别地,证明了$E[X|Y=y]$的$k$阶导数是$(k+1)$阶条件累积量.本文的第三部分考虑了一些应用。在第一个应用中,$E[X|Y=y]$的幂级数和组成逆推导。在第二应用中,导出估计器误差$(X-E[X|Y])$的分布。在第三个应用程序中,我们构造一致的估计(经验贝叶斯估计)的条件累积量从一个独立同分布。序列$Y_1,...,Y_n$。

英文摘要:

Consider a channel ${\bf Y}={\bf X}+ {\bf N}$ where ${\bf X}$ is an $n$-dimensional random vector, and ${\bf N}$ is a Gaussian vector with a covariance matrix ${\bf \mathsf{K}}_{\bf N}$. The object under consideration in this paper is the conditional mean of ${\bf X}$ given ${\bf Y}={\bf y}$, that is ${\bf y} \to E[{\bf X}|{\bf Y}={\bf y}]$. Several identities in the literature connect $E[{\bf X}|{\bf Y}={\bf y}]$ to other quantities such as the conditional variance, score functions, and higher-order conditional moments. The objective of this paper is to provide a unifying view of these identities. In the first part of the paper, a general derivative identity for the conditional mean is derived. Specifically, for the Markov chain ${\bf U} \leftrightarrow {\bf X} \leftrightarrow {\bf Y}$, it is shown that the Jacobian of $E[{\bf U}|{\bf Y}={\bf y}]$ is given by ${\bf \mathsf{K}}_{\bf N}^{-1} {\bf Cov} ( {\bf X}, {\bf U} | {\bf Y}={\bf y})$. In the second part of the paper, via various choices of ${\bf U}$, the new identity is used to generalize many of the known identities and derive some new ones. First, a simple proof of the Hatsel and Nolte identity for the conditional variance is shown. Second, a simple proof of the recursive identity due to Jaffer is provided. Third, a new connection between the conditional cumulants and the conditional expectation is shown. In particular, it is shown that the $k$-th derivative of $E[X|Y=y]$ is the $(k+1)$-th conditional cumulant. The third part of the paper considers some applications. In a first application, the power series and the compositional inverse of $E[X|Y=y]$ are derived. In a second application, the distribution of the estimator error $(X-E[X|Y])$ is derived. In a third application, we construct consistent estimators (empirical Bayes estimators) of the conditional cumulants from an i.i.d. sequence $Y_1,...,Y_n$.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑