arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1210.5902cs.ITmath.IT
收藏

共享信息--复杂系统信息分解的新见解和问题

Shared Information -- New Insights and Problems in Decomposing Information in Complex Systems

Nils Bertschinger, Johannes Rauh, Eckehard Olbrich, Jürgen Jost

摘要:

如何分解一组随机变量${X_{1},...,X_{n}}$包含的关于另一个随机变量$S$的信息?不同的分组在多大程度上提供相同的信息,即共享或多余的信息,携带独特的信息或相互作用以产生协同信息?最近,Williams和Beer提出了基于共享信息的自然属性的分解。虽然这些属性固定了分解的结构,但它们并不唯一地指定不同项的值。因此,我们研究额外的性质,如强对称性和左单调性。我们发现强对称性与Williams和Beer提出的性质是不相容的。虽然左单调性是信息测度的一个非常自然的性质,但它并没有被任何提出的测度所满足。我们还研究了信息分解的几何框架,并询问是否有可能表示共享信息的后验分布的家庭。最后,我们得出的共享知识和共同知识的概念在博弈论的连接。虽然许多人认为独立变量不能共享信息,但我们证明了在博弈论中独立代理可以共享知识,但不能共享知识。我们的结论是,直觉和启发式参数不足以争论的信息。

英文摘要:

How can the information that a set ${X_{1},...,X_{n}}$ of random variables contains about another random variable $S$ be decomposed? To what extent do different subgroups provide the same, i.e. shared or redundant, information, carry unique information or interact for the emergence of synergistic information? Recently Williams and Beer proposed such a decomposition based on natural properties for shared information. While these properties fix the structure of the decomposition, they do not uniquely specify the values of the different terms. Therefore, we investigate additional properties such as strong symmetry and left monotonicity. We find that strong symmetry is incompatible with the properties proposed by Williams and Beer. Although left monotonicity is a very natural property for an information measure it is not fulfilled by any of the proposed measures. We also study a geometric framework for information decompositions and ask whether it is possible to represent shared information by a family of posterior distributions. Finally, we draw connections to the notions of shared knowledge and common knowledge in game theory. While many people believe that independent variables cannot share information, we show that in game theory independent agents can have shared knowledge, but not common knowledge. We conclude that intuition and heuristic arguments do not suffice when arguing about information.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑