arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1908.08642cs.ITmath.ITq-bio.NCstat.ML
收藏

一种新的部分信息分解方法

A Novel Approach to the Partial Information Decomposition

Artemy Kolchinsky

摘要:

我们认为“部分信息分解”(PID)问题,其目的是分解的信息,一组源随机变量提供了一个目标随机变量到单独的冗余,协同,工会,和独特的组件。在本文的第一部分中,我们提出了一个一般的框架,构建一个多变量PID。我们的框架是定义在一个正式的类比与交集和工会从集合论,随着一个排序关系,指定当一个信息源比另一个信息。我们的定义是代数和公理的动机,并可以推广到领域以外的香农信息论(如算法信息论和量子信息论)。在本文的第二部分中,我们使用我们的一般框架来定义一个PID的著名的Blackwell顺序,这有一个基本的操作解释。我们证明了我们的方法在许多例子,并表明它克服了许多与以前的建议相关的缺点。

英文摘要:

We consider the "partial information decomposition" (PID) problem, which aims to decompose the information that a set of source random variables provide about a target random variable into separate redundant, synergistic, union, and unique components. In the first part of this paper, we propose a general framework for constructing a multivariate PID. Our framework is defined in terms of a formal analogy with intersection and union from set theory, along with an ordering relation which specifies when one information source is more informative than another. Our definitions are algebraically and axiomatically motivated, and can be generalized to domains beyond Shannon information theory (such as algorithmic information theory and quantum information theory). In the second part of this paper, we use our general framework to define a PID in terms of the well-known Blackwell order, which has a fundamental operational interpretation. We demonstrate our approach on numerous examples and show that it overcomes many drawbacks associated with previous proposals.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑