arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1303.6708q-bio.NC
收藏

硬件约束下基于奖励的学习--使用嵌入神经形态基底的RISC处理器

Reward-based learning under hardware constraints - Using a RISC processor embedded in a neuromorphic substrate

Simon Friedmann, Nicolas Frémaux, Johannes Schemmel, Wulfram Gerstner, Karlheinz Meier

摘要:

在这项研究中,我们提出并分析了一种新的,高度灵活的方法,实现突触可塑性在晶圆级,加速神经形态硬件系统的模拟。该研究的重点是全局调制STDP,作为这种方法的一个特殊用例。灵活性是通过嵌入一个通用处理器专用于可塑性到晶圆。为了评估所提出的系统的适用性,我们在脉冲序列学习任务中使用奖励调制STDP规则。单层神经元被训练在特定的时间点发射,只有奖励作为反馈。该模型被模拟以测量其性能,即学习后收到的奖励的增加。使用此性能作为基线,然后我们模拟模型与所提出的实现所施加的各种约束,并比较性能。模拟的约束包括离散化的突触权重、模拟突触与嵌入式处理器之间的受限接口以及模拟电路的失配。我们发现,概率更新可以提高低分辨率权重的性能,模拟突触和处理器之间的简单接口足以进行学习,并且性能对失配不敏感。此外,我们考虑晶圆和传统的控制计算机系统,模拟环境之间的通信延迟。这种延迟增加了将奖励发送到嵌入式处理器的延迟。由于模拟突触的时间连续操作,与未延迟的情况相比,延迟可能导致更新的偏差。我们发现,对于高度加速的系统延迟必须保持在最低限度。这项研究表明,所提出的实施方案,以模拟选定的奖励调制STDP学习规则的适用性。

英文摘要:

In this study, we propose and analyze in simulations a new, highly flexible method of implementing synaptic plasticity in a wafer-scale, accelerated neuromorphic hardware system. The study focuses on globally modulated STDP, as a special use-case of this method. Flexibility is achieved by embedding a general-purpose processor dedicated to plasticity into the wafer. To evaluate the suitability of the proposed system, we use a reward modulated STDP rule in a spike train learning task. A single layer of neurons is trained to fire at specific points in time with only the reward as feedback. This model is simulated to measure its performance, i.e. the increase in received reward after learning. Using this performance as baseline, we then simulate the model with various constraints imposed by the proposed implementation and compare the performance. The simulated constraints include discretized synaptic weights, a restricted interface between analog synapses and embedded processor, and mismatch of analog circuits. We find that probabilistic updates can increase the performance of low-resolution weights, a simple interface between analog synapses and processor is sufficient for learning, and performance is insensitive to mismatch. Further, we consider communication latency between wafer and the conventional control computer system that is simulating the environment. This latency increases the delay, with which the reward is sent to the embedded processor. Because of the time continuous operation of the analog synapses, delay can cause a deviation of the updates as compared to the not delayed situation. We find that for highly accelerated systems latency has to be kept to a minimum. This study demonstrates the suitability of the proposed implementation to emulate the selected reward modulated STDP learning rule.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑