双层神经网络信息非线性的微扰方法
A perturbative approach to non-linearities in the information carried by a two layer neural network
摘要:
我们评估的两层网络的输入和输出之间的互信息的情况下,一个嘈杂的和非线性的模拟通道。在非线性是小的情况下,相对于噪声的变化,我们推导出一个精确的表达式的贡献的互信息的非线性项在一阶扰动理论。最后,我们展示了如何计算可以简化通过一个图形的扩展。我们的研究结果表明,使用微扰理论应用于神经系统的非线性的信息传输的贡献,并在一般的神经元动力学可能会给一个洞察力。
英文摘要:
We evaluate the mutual information between the input and the output of a two layer network in the case of a noisy and non-linear analogue channel. In the case where the non-linearity is small with respect to the variability in the noise, we derive an exact expression for the contribution to the mutual information given by the non-linear term in first order of perturbation theory. Finally we show how the calculation can be simplified by means of a diagrammatic expansion. Our results suggest that the use of perturbation theories applied to neural systems might give an insight on the contribution of non-linearities to the information transmission and in general to the neuronal dynamics.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。