多分量神经网络非对称随机矩阵的特征值谱
Eigenvalue spectra of asymmetric random matrices for multi-component neural networks
摘要:
本文重点研究了大型神经网络,其突触连接矩阵是从某些随机矩阵集成中随机选择的。这些网络的动力学特性可以通过其连接矩阵的特征值谱来表征。实际上,网络中的神经元不一定以类似的方式表现,但可能属于几个不同的类别。第一个研究双组分神经网络的谱是由Rajan和Abbott进行的。在他们的模型中,神经元是“兴奋性”或“兴奋性”的,来自不同类型神经元的突触强度具有不同均值和方差的高斯分布。Rajan和Abbott的一个令人惊讶的发现是,这些类型的随机突触矩阵的本征值谱不依赖于其元素的平均值。在本文中,我们证明了这是真的,即使是一个更一般类型的随机神经网络,其中有一个有限数量的类型的神经元,其突触强度有相关的分布。此外,我们还利用图解法计算了多分量神经网络突触矩阵谱的显式表达式。
英文摘要:
This paper focuses on large neural networks whose synaptic connectivity matrices are randomly chosen from certain random matrix ensembles. The dynamics of these networks can be characterized by the eigenvalue spectra of their connectivity matrices. In reality, neurons in a network do not necessarily behave in a similar way, but may belong to several different categories. The first study of the spectra of two-component neural networks was carried out by Rajan and Abbott. In their model, neurons are either 'excitatory' or 'inhibitory', and strengths of synapses from different types of neurons have Gaussian distributions with different means and variances. A surprising finding by Rajan and Abbott is that the eigenvalue spectra of these types of random synaptic matrices do not depend on the mean values of their elements. In this paper we prove that this is true even for a much more general type of random neural network, where there is a finite number of types of neurons, and their synaptic strengths have correlated distributions. Furthermore, using the diagrammatic techniques, we calculate the explicit formula for the spectra of synaptic matrices of multi-component neural networks.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。