一个信息论小数律的单调收敛性
Monotonic Convergence in an Information-Theoretic Law of Small Numbers
摘要:
在离散情况下,得到了类似于熵中心极限定理(Barron 1986; Artstein et al. 2004)的“熵增加到最大值”的结果。这涉及细化操作和泊松极限。对于一般离散分布,证明了相对熵的单调收敛性,对于特殊的超对数凹分布,证明了Shannon熵的单调增加性.总的来说,我们扩展了Kontoyiannis等人(2005)和Harremoës等人探索的信息论中心极限定理和小数定律之间的相似性。(2007,2008)。证明中的成分包括凸性、优控制和随机序。
英文摘要:
An "entropy increasing to the maximum" result analogous to the entropic central limit theorem (Barron 1986; Artstein et al. 2004) is obtained in the discrete setting. This involves the thinning operation and a Poisson limit. Monotonic convergence in relative entropy is established for general discrete distributions, while monotonic increase of Shannon entropy is proved for the special class of ultra-log-concave distributions. Overall we extend the parallel between the information-theoretic central limit theorem and law of small numbers explored by Kontoyiannis et al. (2005) and Harremoës et al.\ (2007, 2008). Ingredients in the proofs include convexity, majorization, and stochastic orders.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。