arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 1910.06152cs.ET
收藏

Crossbar阵列的错误触发三因素学习动力学

Error-triggered Three-Factor Learning Dynamics for Crossbar Arrays

Melika Payvand, Mohammed Fouda, Fadi Kurdahi, Ahmed Eltawil, Emre O. Neftci

摘要:

最近的突破表明,局部近似梯度下降学习与脉冲神经网络(SNN)兼容。虽然SNN可以使用神经形态VLSI可扩展地实现,但仍然缺少可以像传统处理器一样精确地原位学习的架构。在这里,我们提出了一个亚阈值电路架构,通过从机器学习和计算神经科学,可以实现这样的精度获得的见解设计。使用代理梯度学习框架,我们得到本地的,错误触发的学习动态兼容交叉阵列和SNN的时间动态。推导表明,用于推理和训练动态的电路可以共享,这简化了电路,抑制了制造失配的影响。我们目前的SPICE模拟XFAB 180纳米工艺,以及基于事件的基准测试,包括手势识别任务的脉冲神经网络的大规模模拟。我们的研究结果表明,与标准规则相比,更新的数量可以减少一百倍,同时实现与最先进的性能相当的性能。

英文摘要:

Recent breakthroughs suggest that local, approximate gradient descent learning is compatible with Spiking Neural Networks (SNNs). Although SNNs can be scalably implemented using neuromorphic VLSI, an architecture that can learn in-situ as accurately as conventional processors is still missing. Here, we propose a subthreshold circuit architecture designed through insights obtained from machine learning and computational neuroscience that could achieve such accuracy. Using a surrogate gradient learning framework, we derive local, error-triggered learning dynamics compatible with crossbar arrays and the temporal dynamics of SNNs. The derivation reveals that circuits used for inference and training dynamics can be shared, which simplifies the circuit and suppresses the effects of fabrication mismatch. We present SPICE simulations on XFAB 180nm process, as well as large-scale simulations of the spiking neural networks on event-based benchmarks, including a gesture recognition task. Our results show that the number of updates can be reduced hundred-fold compared to the standard rule while achieving performances that are on par with the state-of-the-art.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑