arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1806.09057cs.NEcs.ET
收藏

基于神经网络的MTJ Crossbar网络的现场随机训练

In-situ Stochastic Training of MTJ Crossbar based Neural Networks

Ankit Mondal, Ankur Srivastava

摘要:

由于高器件密度、可扩展性和非易失性,基于磁隧道结的交叉开关已经获得了用于实现人工神经网络的权重的显著兴趣。MTJ中仅存在两个稳态意味着在软件中获得最佳二进制权重的高开销。我们说明,在交叉结构中的固有的并行性,使其非常适合于在现场的培训,其中的网络是直接在硬件上教。由于训练时间与网络的大小无关,因此其导致显著更小的训练开销,同时还避免了交叉开关中的交替电流路径的影响并考虑了器件中的制造变化。我们展示了如何利用MTJ的随机切换特性来使用梯度下降算法执行概率权重更新。我们描述了如何更新操作可以在交叉开关上进行,有和没有存取晶体管,并对它们进行模拟,以证明我们的技术的有效性。结果表明,随机训练的MTJ-crossbar神经网络的分类精度几乎与在软件中训练的实值权重网络相同,并且对设备变化具有免疫力。

英文摘要:

Owing to high device density, scalability and non-volatility, Magnetic Tunnel Junction-based crossbars have garnered significant interest for implementing the weights of an artificial neural network. The existence of only two stable states in MTJs implies a high overhead of obtaining optimal binary weights in software. We illustrate that the inherent parallelism in the crossbar structure makes it highly appropriate for in-situ training, wherein the network is taught directly on the hardware. It leads to significantly smaller training overhead as the training time is independent of the size of the network, while also circumventing the effects of alternate current paths in the crossbar and accounting for manufacturing variations in the device. We show how the stochastic switching characteristics of MTJs can be leveraged to perform probabilistic weight updates using the gradient descent algorithm. We describe how the update operations can be performed on crossbars both with and without access transistors and perform simulations on them to demonstrate the effectiveness of our techniques. The results reveal that stochastically trained MTJ-crossbar NNs achieve a classification accuracy nearly same as that of real-valued-weight networks trained in software and exhibit immunity to device variations.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑