通过复杂的信息共享理解相互依赖性
Understanding interdependency through complex information sharing
摘要:
三个或更多随机变量之间的相互作用通常是不平凡的,人们对它的理解很少,但它对网络信息论、神经科学、遗传学等领域的未来发展至关重要。在这项工作中,我们建议分析这些相互作用的不同模式的信息共享。为此,我们引入了一个新的公理框架分解的联合熵,其特征在于随机变量可以共享信息的各种方式。我们的框架的关键贡献是区分信息冗余共享的相互依赖性和共享结构存在于整体而不是部分之间的协同相互依赖性。我们表明,我们的公理确定唯一的公式为所有条款的建议分解的一些情况下的利益。此外,我们展示了如何将这些结果应用于几个网络信息论问题,提供了一个更直观的了解他们的基本限制。
英文摘要:
The interactions between three or more random variables are often nontrivial, poorly understood, and yet, are paramount for future advances in fields such as network information theory, neuroscience, genetics and many others. In this work, we propose to analyze these interactions as different modes of information sharing. Towards this end, we introduce a novel axiomatic framework for decomposing the joint entropy, which characterizes the various ways in which random variables can share information. The key contribution of our framework is to distinguish between interdependencies where the information is shared redundantly, and synergistic interdependencies where the sharing structure exists in the whole but not between the parts. We show that our axioms determine unique formulas for all the terms of the proposed decomposition for a number of cases of interest. Moreover, we show how these results can be applied to several network information theory problems, providing a more intuitive understanding of their fundamental limits.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。