arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1807.03609cond-mat.dis-nnmath-phmath.MP
收藏

非凸多种群Hopfield模型

Non-Convex Multi-species Hopfield models

Elena Agliari, Danila Migliozzi, Daniele Tantari

摘要:

在这项工作中,我们介绍了一个多物种的推广的Hopfield模型的联想记忆,神经元被分成组,并考虑组间和组内成对的相互作用,具有不同的强度。因此,这个系统包含了现代深度神经网络架构的两个主要成分:存储信息模式的赫布交互和编码不同级别相关性的多层。该模型是完全可解的,在低负载政权与适当的推广的哈密顿-雅可比技术,尽管哈密顿可以是一个非定二次形式的磁化。多种群Hopfield模型族包括具有高斯隐层的3层限制玻尔兹曼机(RBM)和双向联想记忆(BAM)模型。

英文摘要:

In this work we introduce a multi-species generalization of the Hopfield model for associative memory, where neurons are divided into groups and both inter-groups and intra-groups pair-wise interactions are considered, with different intensities. Thus, this system contains two of the main ingredients of modern Deep neural network architectures: Hebbian interactions to store patterns of information and multiple layers coding different levels of correlations. The model is completely solvable in the low-load regime with a suitable generalization of the Hamilton-Jacobi technique, despite the Hamiltonian can be a non-definite quadratic form of the magnetizations. The family of multi-species Hopfield model includes, as special cases, the 3-layers Restricted Boltzmann Machine (RBM) with Gaussian hidden layer and the Bidirectional Associative Memory (BAM) model.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑