We investigated how the stability of macroscopic states in the associative memory model is affected by synaptic depression. To this model, we applied the dynamical mean-field theory, which has recently been developed in stochastic neural network models with synaptic depression. By introducing a sublattice method, we derived macroscopic equations for firing state variables and depression variables. By using the macroscopic equations, we obtained the phase diagram when the strength of synaptic depression and the correlation level among stored patterns were changed. We found that there is an unstable region in which both the memory state and mixed state cannot be stable and that various switching phenomena can occur in this region.
The University of Tokyo(东京大学);Department of Physics, The University of Tokyo(东京大学物理系);Institute for Physics of Intelligence, The University of Tokyo(东京大学智能物理研究所);Trans-Scale Quantum Science Institute, The University of Tokyo(东京大学跨尺度量子科学研究所)
A Hardware-aware Hopfield Network with a Nonlinear Memristor Array for Robust Associative Memory with Superlinear Capacity
Korea Institute of Science and Technology (KIST)(韩国科学技术院);Korea Advanced Institute of Science and Technology (KAIST)(韩国科学技术院);Seoul National University(首尔大学);Korea University(韩国大学);KIST School, University of Science and Technology(韩国科学技术院科学技术研究生院)
Short-term plasticity recalls forgotten memories through a trampoline mechanism
Institute for Computational and Mathematical Engineering, Stanford University(斯坦福大学计算与数学工程研究所);Department of Applied Physics, Stanford University(斯坦福大学应用物理系)
Bernstein Center for Computational Neuroscience(伯恩施坦计算神经科学中心);Physics Department of Humboldt-Universität zu Berlin(柏林洪堡大学物理系);Institute for Theoretical Biology, Department of Biology, Humboldt-Universität zu Berlin(柏林洪堡大学生物学院理论生物学研究所);Einstein Center for Neurosciences Berlin(柏林爱因斯坦神经科学中心)
Firing Rate Models as Associative Memory: Excitatory-Inhibitory Balance for Robust Retrieval
Department of Information Engineering(信息工程系);Università degli Studi di Padova(帕多瓦大学);Center for Control, Dynamical Systems and Computation(控制、动态系统与计算中心);University of California at Santa Barbara(加州大学圣巴巴拉分校)
Large Associative Memory Problem in Neurobiology and Machine Learning
MIT-IBM Watson AI Lab(MIT-IBM沃森人工智能实验室);IBM Research(IBM研究院);Princeton Neuroscience Institute(普林斯顿神经科学研究所);Princeton University(普林斯顿大学)
密集关联记忆或现代Hopfield网络允许存储和可靠检索指数级大(在特征空间的维度上)数量的记忆。与此同时,它们的朴素实现是非生物的,因为它似乎需要神经元之间存在多体突触连接。我们表明,这些模型是一个更微观的(书面的生物自由度)理论,有额外的(隐藏的)神经元,只需要两个身体之间的相互作用的有效描述。由于这个原因,我们提出的微观理论是一个有效的模型,大联想记忆与一定程度的生物相容性。我们的网络的动力学和它的降维等效都最小化能量(李雅普诺夫)函数。当某些动态变量(隐藏神经元)从我们的微观理论中整合出来时,可以恢复许多以前在文献中讨论过的模型,例如“Hopfield Networks is All You Need”论文中提出的模型。我们还提供了另一种推导的能量函数和更新规则中提出的上述文件,并澄清这一类的各种模型之间的关系。
Observation of associative-memory retrieval and spin-glass phases on a photonic quantum simulator
Sapienza Università di Roma(罗马大学);Università del Salento(萨伦托大学);Institute of Nanotechnology of the National Research Council of Italy, CNR-NANOTEC(意大利国家研究委员会纳米技术研究所);Università degli Studi di Salerno(萨莱诺大学);INFN, Sezione di Napoli, Gruppo Collegato di Salerno(意大利国家核物理研究所那不勒斯分部萨莱诺协作组);Department of Computing Sciences, Bocconi University(博科尼大学计算科学系);Istituto di Fotonica e Nanotecnologie, Consiglio Nazionale delle Ricerche (IFN-CNR)(意大利国家研究委员会光子和纳米技术研究所)