arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 0710.1275cs.ITmath.IT
收藏

关于Shannon熵的收敛性质

On Convergence Properties of Shannon Entropy

Francisco J. Piera, Patricio Parada

摘要:

研究了Shannon熵的收敛性质。在微分设置,它表明,弱收敛的概率措施,或收敛的分布,是不够的相关的微分熵的收敛。所需的微分熵收敛的一般结果提供,同时考虑到紧和非紧支持的密度。收敛的微分熵的特点也是在Kullback-Liebler判别的密度与相当普遍的支持,它表明,收敛的概率措施的变化,保证这种收敛下一个适当的有界性条件的密度。离散设置的结果也提供了,允许无限支持的概率措施,利用弱收敛和收敛之间的等价性在此设置中的变化。

英文摘要:

Convergence properties of Shannon Entropy are studied. In the differential setting, it is shown that weak convergence of probability measures, or convergence in distribution, is not enough for convergence of the associated differential entropies. A general result for the desired differential entropy convergence is provided, taking into account both compactly and uncompactly supported densities. Convergence of differential entropy is also characterized in terms of the Kullback-Liebler discriminant for densities with fairly general supports, and it is shown that convergence in variation of probability measures guarantees such convergence under an appropriate boundedness condition on the densities involved. Results for the discrete setting are also provided, allowing for infinitely supported probability measures, by taking advantage of the equivalence between weak convergence and convergence in variation in this setting.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑