arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 0904.1446cs.ITmath.IT
收藏

稀疏下熵的凹性

Concavity of entropy under thinning

Yaming Yu, Oliver Johnson

摘要:

在Johnson(2007)和Yu(2008)的工作基础上,我们证明了熵是关于细化操作T_a的凹函数。也就是说,如果X和Y是Z+上具有超对数凹概率质量函数的独立随机变量,则H(T_aX + T_{1-a} Y)>= aH(X)+(1-a)H(Y),0 <= a <= 1,其中H表示离散熵.这是不等式(h表示微分熵)h(sqrt(a)X + sqrt{1-a} Y)>= a h(X)+(1-a)h(Y),0 <= a <= 1的离散模拟,其对具有有限方差的连续X和Y成立,并且等价于香农熵幂不等式。因此,我们建立了Shepp和Olkin(1981)猜想的一个特例.

英文摘要:

Building on the recent work of Johnson (2007) and Yu (2008), we prove that entropy is a concave function with respect to the thinning operation T_a. That is, if X and Y are independent random variables on Z_+ with ultra-log-concave probability mass functions, then H(T_a X+T_{1-a} Y)>= a H(X)+(1-a)H(Y), 0 <= a <= 1, where H denotes the discrete entropy. This is a discrete analogue of the inequality (h denotes the differential entropy) h(sqrt(a) X + sqrt{1-a} Y)>= a h(X)+(1-a) h(Y), 0 <= a <= 1, which holds for continuous X and Y with finite variances and is equivalent to Shannon's entropy power inequality. As a consequence we establish a special case of a conjecture of Shepp and Olkin (1981).

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑