arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1907.05484cs.ITmath.IT
收藏

广义互信息

Generalized Mutual Information

Zhiyi Zhang

摘要:

互信息是信息论的基本组成部分之一。然而,它只被定义为快速衰减的尾巴上的两个随机元素的可数联合字母表的分布。联合字母表上所有分布的一般类上的互信息的无界性阻止了其潜在的效用被充分实现。这实际上是信息论基础上的一个需要填补的空白。本文提出了一个广义互信息族,它的所有成员(1)除了Shannon定义的互信息外,对联合可数字母表上两个随机元素的每一个分布都有严格的定义;(2)具有有限Shannon互信息的所有效用。

英文摘要:

Mutual information is one of the essential building blocks of information theory. Yet, it is only finitely defined for distributions with fast decaying tails on a countable joint alphabet of two random elements. The unboundedness of mutual information over the general class of all distributions on a joint alphabet prevents its potential utility to be fully realized. This is in fact a void in the foundation of information theory that needs to be filled. This article proposes a family of generalized mutual information all of whose members 1) are finitely defined for each and every distribution of two random elements on a joint countable alphabet, except the one by Shannon, and 2) enjoy all utilities of a finite Shannon's mutual information.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑