In this article, a novel neuro-inspired low-resolution online unsupervised learning rule is proposed to train the reservoir or liquid of Liquid State Machine. The liquid is a sparsely interconnected huge recurrent network of spiking neurons. The proposed learning rule is inspired from structural plasticity and trains the liquid through formation and elimination of synaptic connections. Hence, the learning involves rewiring of the reservoir connections similar to structural plasticity observed in biological neural networks. The network connections can be stored as a connection matrix and updated in memory by using Address Event Representation (AER) protocols which are generally employed in neuromorphic systems. On investigating the 'pairwise separation property' we find that trained liquids provide 1.36 $\pm$ 0.18 times more inter-class separation while retaining similar intra-class separation as compared to random liquids. Moreover, analysis of the 'linear separation property' reveals that trained liquids are 2.05 $\pm$ 0.27 times better than random liquids. Furthermore, we show that our liquids are able to retain the 'generalization' ability and 'generality' of random liquids. A memory analysis shows that trained liquids have 83.67 $\pm$ 5.79 ms longer fading memory than random liquids which have shown 92.8 $\pm$ 5.03 ms fading memory for a particular type of spike train inputs. We also throw some light on the dynamics of the evolution of recurrent connections within the liquid. Moreover, compared to 'Separation Driven Synaptic Modification' - a recently proposed algorithm for iteratively refining reservoirs, our learning rule provides 9.30%, 15.21% and 12.52% more liquid separations and 2.8%, 9.1% and 7.9% better classification accuracies for four, eight and twelve class pattern recognition tasks respectively.
Unveiling the role of plasticity rules in reservoir computing
Instituto de Física Interdisciplinar y Sistemas Complejos (IFISC, UIB-CSIC)(跨学科物理与复杂系统研究所(IFISC,巴利阿里群岛大学-西班牙国家研究委员会));Instituto Carlos I de Física Teórica y Computacional(卡洛斯一世理论与计算物理研究所)
Short-Term Synaptic Plasticity Stabilizes Goal-Conditioned Dynamics in a PFC-Inspired Reservoir Model for Multistep Goal-Directed Action Planning
Graduate School of Information Science and Technology, The University of Osaka(大阪大学研究生院信息科学技术学院);School of Systems Information Science, Future University Hakodate(函馆未来大学系统信息科学学院)
Plasticity-Enhanced Domain-Wall MTJ Neural Networks for Energy-Efficient Online Learning
Sandia National Laboratories(桑迪亚国家实验室);University of Texas at Austin(得克萨斯大学奥斯汀分校);University of Texas at Dallas(得克萨斯大学达拉斯分校);Air Force Research Laboratory(空军研究实验室)
Embodied Synaptic Plasticity with Online Reinforcement learning
FZI Research Center for Information Technology(FZI信息技术研究中心);Graz University of Technology(格拉茨技术大学);Georg-August Universität(哥廷根乔治-奥古斯特大学);Technische Universität Dresden(德累斯顿工业大学)
A Cloud-Edge Framework for Energy-Efficient Event-Driven Control: An Integration of Online Supervised Learning, Spiking Neural Networks and Local Plasticity Rules
Voltage-Dependent Synaptic Plasticity (VDSP): Unsupervised probabilistic Hebbian plasticity rule based on neurons membrane potential
Institut Interdisciplinaire d’Innovation Technologique (3IT), Université de Sherbrooke(舍布鲁克大学跨学科技术创新研究所(3IT));Laboratoire Nanotechnologies Nanosystèmes (LN2) – CNRS UMI-3463, Université de Sherbrooke(舍布鲁克大学纳米技术与纳米系统实验室(LN2)——法国国家科学研究中心联合国际研究单位3463);Institute of Electronics, Microelectronics and Nanotechnology (IEMN), Université de Lille(里尔大学电子、微电子与纳米技术研究所(IEMN));Aix Marseille Univ(艾克斯-马赛大学);Université de Toulon(土伦大学);CNRS(法国国家科学研究中心);IM2NP(材料、微电子与纳米科学普罗旺斯研究所(IM2NP));National Research Council Canada(加拿大国家研究委员会);University of Waterloo Collaboration Centre(滑铁卢大学合作中心);Université Paris-Saclay(巴黎萨克雷大学);Centre de Nanosciences et de Nanotechnologies(纳米科学与纳米技术中心)
A Biologically Plausible Supervised Learning Method for Spiking Neural Networks Using the Symmetric STDP Rule
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);University of Chinese Academy of Sciences(中国科学院大学);CAS Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences(中国科学院脑科学与智能技术卓越创新中心)