arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1506.00253cs.ITmath.IT
收藏

最低MS。E. Gerber引理

Minimum MS. E. Gerber's Lemma

Or Ordentlich, Ofer Shayevitz

摘要:

Gerber夫人引理根据输入过程的熵来下界二进制对称信道的输出处的熵。在本文中,我们下界的输出熵通过不同的输入不确定性的措施,有关的最小均方误差(MMSE)预测成本的输入过程。我们表明,在许多情况下,我们的界限是更严格的一个从Gerber夫人的引理。作为应用,我们评估了二元隐马尔可夫过程的界,并获得了新的估计的熵率。

英文摘要:

Mrs. Gerber's Lemma lower bounds the entropy at the output of a binary symmetric channel in terms of the entropy of the input process. In this paper, we lower bound the output entropy via a different measure of input uncertainty, pertaining to the minimum mean squared error (MMSE) prediction cost of the input process. We show that in many cases our bound is tighter than the one obtained from Mrs. Gerber's Lemma. As an application, we evaluate the bound for binary hidden Markov processes, and obtain new estimates for the entropy rate.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑