arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1604.01969math.PRcs.ITmath-phmath.ITmath.MPmath.OC
收藏

高斯扩散过程中的转移熵和有向信息

Transfer Entropy and Directed Information in Gaussian diffusion processes

Nigel J. Newton

摘要:

传递熵和有向信息是随机过程之间方向依赖性的信息论度量。根据Schreiber和Massey在离散时间中的定义,我们定义并评估了多维高斯扩散过程分量的这些测度。当组件联合马尔可夫,转移熵和有向信息都是影响的措施,根据一个简单的物理原理。更一般地,必须考虑其他组件的影响,并且这可以以多种方式实现。我们提出了两个定义,其中之一保留了联合马尔可夫情况下的影响的属性。转移熵和有向信息用矩阵Riccati方程的解表示,便于计算。我们提出的连续时间有向信息的定义不同于以前出现在文献中。我们认为,后者不是严格的方向。

英文摘要:

Transfer Entropy and Directed Information are information-theoretic measures of the directional dependency between stochastic processes. Following the definitions of Schreiber and Massey in discrete time, we define and evaluate these measures for the components of multidimensional Gaussian diffusion processes. When the components are jointly Markov, the Transfer Entropy and Directed Information are both measures of influence according to a simple physical principle. More generally, the effect of other components has to be accounted for, and this can be achieved in more than one way. We propose two definitions, one of which preserves the properties of influence of the jointly Markov case. The Transfer Entropy and Directed Information are expressed in terms of the solutions of matrix Riccati equations, and so are easy to compute. The definition of continuous-time Directed Information we propose differs from that previously appearing in the literature. We argue that the latter is not strictly directional.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑