arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1602.04577cs.ITmath.IT
收藏

Relations Between Conditional Shannon Entropy and Expectation of $\ell_α$-Norm

Yuta Sakai, Ken-ichi Iwata

英文摘要:

The paper examines relationships between the conditional Shannon entropy and the expectation of $\ell_α$-norm for joint probability distributions. More precisely, we investigate the tight bounds of the expectation of $\ell_α$-norm with a fixed conditional Shannon entropy, and vice versa. As applications of the results, we derive the tight bounds between the conditional Shannon entropy and several information measures which are determined by the expectation of $\ell_α$-norm, e.g., the conditional Rényi entropy and the conditional $R$-norm information. Moreover, we apply these results to discrete memoryless channels under a uniform input distribution. Then, we show the tight bounds of Gallager's $E_{0}$ functions with a fixed mutual information under a uniform input distribution.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑