arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1207.2080cs.ITmath.ITphysics.data-an
收藏

冗余信息的二元度量

A Bivariate Measure of Redundant Information

Malte Harder, Christoph Salge, Daniel Polani

摘要:

我们定义了一个测量的冗余信息的基础上的概率分布的空间中的投影。随机变量之间的冗余信息是这些变量之间共享的信息。但与互信息相反,冗余信息表示关于第三变量的结果的共享信息。形式化这个概念,并能够测量它,需要非负分解的互信息为冗余和协同信息。以前的尝试,形式化冗余或协同信息的斗争,以捕捉一些所需的属性。我们引入了一个新的形式主义的冗余信息,并证明它满足所有的属性,在早期的工作,以及一个额外的标准,我们建议是必要的捕获冗余。我们还证明了这种新的措施的几个例子的行为,比较它与以前的措施,并将其应用到转移熵的分解。

英文摘要:

We define a measure of redundant information based on projections in the space of probability distributions. Redundant information between random variables is information that is shared between those variables. But in contrast to mutual information, redundant information denotes information that is shared about the outcome of a third variable. Formalizing this concept, and being able to measure it, is required for the non-negative decomposition of mutual information into redundant and synergistic information. Previous attempts to formalize redundant or synergistic information struggle to capture some desired properties. We introduce a new formalism for redundant information and prove that it satisfies all the properties necessary outlined in earlier work, as well as an additional criterion that we propose to be necessary to capture redundancy. We also demonstrate the behaviour of this new measure for several examples, compare it to previous measures and apply it to the decomposition of transfer entropy.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑