arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1407.5176cond-mat.dis-nnmath-phmath.MP
收藏

分层Dyson模型中的亚稳态驱动分层Hopfield网络中的并行处理

Meta-stable states in the hierarchical Dyson model drive parallel processing in the hierarchical Hopfield network

Elena Agliari, Adriano Barra, Andrea Galluzzi, Francesco Guerra, Daniele Tantari, Flavia Tavani

摘要:

在本文中,我们介绍和调查的统计力学的分层神经网络:首先,我们接近这些系统的马蒂斯,通过考虑戴森模型作为一个单一的模式分层神经网络,我们讨论了不同的可恢复状态的稳定性预测的相关的自适应从一个平均场的限制,并从一个边界,绕过平均场的限制。后者是通过适当地将与层次结构的较高级别相关的磁化波动重新吸收到较低级别的有效场中来计算的。值得注意的是,混合阿米特的ananterior技术(选择候选可恢复状态)与插值程序(解决这些状态的自由能),我们证明(由于规范对称性)戴森模型完成串行和并行处理。向前迈进了一步,我们通过实现Hebb处方来实现耦合内的学习,从而将这种情况扩展到多个存储模式。这就得到了一个约束在层次拓扑结构上的Hopfield类网络,对于这种网络,限制在低存储区(模式数最多与神经元数成几何关系),我们证明了自由能的热力学极限的存在性,并给出了它的平均场界和相关的改进界的显式表达式

英文摘要:

In this paper we introduce and investigate the statistical mechanics of hierarchical neural networks: First, we approach these systems à la Mattis, by thinking at the Dyson model as a single-pattern hierarchical neural network and we discuss the stability of different retrievable states as predicted by the related self-consistencies obtained from a mean-field bound and from a bound that bypasses the mean-field limitation. The latter is worked out by properly reabsorbing fluctuations of the magnetization related to higher levels of the hierarchy into effective fields for the lower levels. Remarkably, mixing Amit's ansatz technique (to select candidate retrievable states) with the interpolation procedure (to solve for the free energy of these states) we prove that (due to gauge symmetry) the Dyson model accomplishes both serial and parallel processing. One step forward, we extend this scenario toward multiple stored patterns by implementing the Hebb prescription for learning within the couplings. This results in an Hopfield-like networks constrained on a hierarchical topology, for which, restricting to the low storage regime (where the number of patterns grows at most logarithmical with the amount of neurons), we prove the existence of the thermodynamic limit for the free energy and we give an explicit expression of its mean field bound and of the related improved bound

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑