二进制通信信道中的信号起伏与信息传输速率
Signal Fluctuations and the Information Transmission Rates in Binary Communication Channels
摘要:
在神经系统中,信息通过动作电位序列(尖峰序列)传递。MacKay和McCulloch提出,尖峰序列可以表示为来自信息源的比特序列。在此之前,我们研究了由尖峰信号进行的信息传输速率(ITR),它们的相关性和频率之间的关系。在这里,我们集中在尖峰波动如何影响ITR的问题。应用Shannon提出的信息论方法。信息源被建模为平稳随机过程。我们假设这样的源作为两个状态马尔可夫过程。作为尖峰序列波动的度量,我们考虑标准差SD,它实际上度量了尖峰在平均尖峰频率周围的平均波动。我们发现ITR和信号涨落关系的性质强烈地依赖于参数s,参数s是从无尖峰态到尖峰态的跃迁概率之和,反之亦然。结果表明,对于较小的s(s<1),商ITR/SD有一个最大值,并且根据转移概率可能趋于零。而对于足够大的s,1<s,ITR/SD对于每个s都与0分离。当我们用多项式近似代替马尔可夫熵公式中的香农熵项时,也观察到类似的行为。我们还表明,方差的ITR商的行为完全不同的方式。我们表明,对于大的过渡参数s的SD的信息传输速率将永远不会减少到0。具体地说,对于1<s<1.7,ITR将总是独立于形成这个s的跃迁概率,高于波动水平,即我们有SD<ITR。我们的结论是,在一个更嘈杂的环境中,要获得适当的可靠性和效率的传输,信息源具有更高的倾向,从无尖峰状态到尖峰状态,反之亦然。
英文摘要:
In nervous system information is conveyed by sequence of action potentials (spikes-trains). As MacKay and McCulloch proposed, spike-trains can be represented as bits sequences coming from Information Sources. Previously, we studied relations between Information Transmission Rates (ITR) carried out by the spikes, their correlations, and frequencies. Here, we concentrate on the problem of how spikes fluctuations affect ITR. The Information Theory Method developed by Shannon is applied. Information Sources are modeled as stationary stochastic processes. We assume such sources as two states Markov processes. As a spike-trains' fluctuation measure, we consider the Standard Deviation SD, which, in fact, measures average fluctuation of spikes around the average spike frequency. We found that character of ITR and signal fluctuations relation strongly depends on parameter s which is a sum of transitions probabilities from no spike state to spike state and vice versa. It turned out that for smaller s (s<1) the quotient ITR/SD has a maximum and can tend to zero depending on transition probabilities. While for s large enough 1<s the ITR/SD is separated from 0 for each s. Similar behavior was observed when we replaced Shannon entropy terms in Markov entropy formula by their approximation with polynomials. We also show that the ITR quotient by Variance behaves in a completely different way. We show that for large transition parameter s the Information Transmission Rate by SD will never decrease to 0. Specifically, for 1<s<1.7 the ITR will be always, independently on transition probabilities which form this s, above the level of fluctuations, i.e. we have SD<ITR. We conclude that in a more noisy environment, to get appropriate reliability and efficiency of transmission, Information Sources with higher tendency of transition from the state no spike to spike state and vice versa should be applied.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。