arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 0706.2048cond-mat.dis-nncond-mat.stat-mech
收藏

具有时变白突触噪声的模拟神经网络的Thouless-Anderson-Palmer方程

Thouless-Anderson-Palmer equation for analog neural network with temporally fluctuating white synaptic noise

Akihisa Ichiki, Masatoshi Shiino

摘要:

从神经生物学和生物物理学的角度研究了突触噪声对联想记忆神经网络提取过程的影响。本文研究了随机模拟神经网络在时间涨落突触噪声(假定为白噪声)作用下的统计力学性质。这样的网络,一般来说,藐视使用的副本方法,因为它们没有能量的概念。自洽信号噪声分析(SCSNA),这是一个替代的副本方法推导出一组序参量方程,不需要能量的概念,从而成为研究网络的能量函数。将SCSNA应用于随机网络需要Thouless-Anderson-Palmer(TAP)方程的知识,TAP方程定义了与原始随机网络等价的确定性网络。TAP方程在无能量概念情况下的研究很少,而在有能量概念的情况下,TAP方程与SCSNA密切相关。本文将腔方法与SCSNA相结合,导出了含突触噪声网络的TAP方程和一组序参量方程。

英文摘要:

Effects of synaptic noise on the retrieval process of associative memory neural networks are studied from the viewpoint of neurobiological and biophysical understanding of information processing in the brain. We investigate the statistical mechanical properties of stochastic analog neural networks with temporally fluctuating synaptic noise, which is assumed to be white noise. Such networks, in general, defy the use of the replica method, since they have no energy concept. The self-consistent signal-to-noise analysis (SCSNA), which is an alternative to the replica method for deriving a set of order parameter equations, requires no energy concept and thus becomes available in studying networks without energy functions. Applying the SCSNA to stochastic network requires the knowledge of the Thouless-Anderson-Palmer (TAP) equation which defines the deterministic networks equivalent to the original stochastic ones. The study of the TAP equation which is of particular interest for the case without energy concept is very few, while it is closely related to the SCSNA in the case with energy concept. This paper aims to derive the TAP equation for networks with synaptic noise together with a set of order parameter equations by a hybrid use of the cavity method and the SCSNA.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑