arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 0710.1280cs.ITmath.IT
收藏

随机动力系统中互信息与最小均方误差的关系

On the Relationship between Mutual Information and Minimum Mean-Square Errors in Stochastic Dynamical Systems

Francisco J. Piera, Patricio Parada

摘要:

我们考虑一个输出随时间演化的一般随机输入-输出动力系统,它是一个由输入过程激励的泛函系数伊藤随机微分方程的解。这类一般的随机系统不仅包括经典的通信信道模型,而且还包括各种各样的工程系统,出现在整个范围的应用。对于这个一般的设置,我们发现类似的已知的关系链接输入-输出互信息和最小平均因果和非因果平方误差,先前建立在加性高斯噪声通信信道的上下文中。关系不仅建立在时间平均的数量,而且他们的时间瞬时,动态对应。在这个一般框架中适当引入通过信噪比参数表示的信噪比概念的问题也被考虑在内,确定适当和有意义的解释的条件。

英文摘要:

We consider a general stochastic input-output dynamical system with output evolving in time as the solution to a functional coefficients, Itô's stochastic differential equation, excited by an input process. This general class of stochastic systems encompasses not only the classical communication channel models, but also a wide variety of engineering systems appearing through a whole range of applications. For this general setting we find analogous of known relationships linking input-output mutual information and minimum mean causal and non-causal square errors, previously established in the context of additive Gaussian noise communication channels. Relationships are not only established in terms of time-averaged quantities, but also their time-instantaneous, dynamical counterparts are presented. The problem of appropriately introducing in this general framework a signal-to-noise ratio notion expressed through a signal-to-noise ratio parameter is also taken into account, identifying conditions for a proper and meaningful interpretation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑