arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2204.10982cs.ITmath.IT
收藏

信息分解的连续性与可加性性质

Continuity and Additivity Properties of Information Decompositions

Johannes Rauh, Pradeep Kr. Banerjee, Eckehard Olbrich, Guido Montúfar, Jürgen Jost

AI总结:

本文研究信息分解的连续性与可加性,针对两个有限变量关于第三个有限变量的互信息,检验各类候选分解,发现大多数满足连续性但仅有一种同时满足连续性与可加性。

摘要:

信息分解量化了关于给定随机变量的香农信息如何在若干其他随机变量之间分布。人们已经提出了各种此类分解应满足的要求,从而产生了不同的候选解。然而,奇怪的是,在决定香农信息的原始要求中,只有两条被考虑过,即单调性和归一化。另外两个重要性质——连续性和可加性——尚未被考虑。在本文中,我们关注两个有限变量 $Y,Z$ 关于第三个有限变量 $S$ 的互信息,并检验哪些分解满足这两个性质。虽然大多数分解满足连续性,但只有其中一个既连续又可加。

英文摘要:

Information decompositions quantify how the Shannon information about a given random variable is distributed among several other random variables. Various requirements have been proposed that such a decomposition should satisfy, leading to different candidate solutions. Curiously, however, only two of the original requirements that determined the Shannon information have been considered, namely monotonicity and normalization. Two other important properties, continuity and additivity, have not been considered. In this contribution, we focus on the mutual information of two finite variables $Y,Z$ about a third finite variable $S$ and check which of the decompositions satisfy these two properties. While most of them satisfy continuity, only one of them is both continuous and additive.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑