arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1811.02187cs.NEcs.ET
收藏

神经网络-基于可扩展随机存取存储器的BNN加速器的硬件协同设计

Neural Network-Hardware Co-design for Scalable RRAM-based BNN Accelerators

Yulhwa Kim, Hyungjun Kim, Jae-Joon Kim

摘要:

最近,基于随机存取存储器的二进制神经网络(BNN)硬件越来越受到关注,因为它只需要1位检测放大器,无需高分辨率ADC和DAC。然而,基于RRAM的BNN硬件仍然需要用于部分和计算的高分辨率ADC来实现使用多个存储器阵列的大规模神经网络。我们提出了一种神经网络-硬件协同设计方法来分割输入,以将每个分割网络适配在RRAM阵列上,使得重建的BNN计算每个阵列中的1位输出神经元。因此,即使对于大规模神经网络,也可以从设计中完全消除ADC。仿真结果表明,所提出的网络重构和再训练恢复了原BNN的推理精度。在CIFAR-10测试中,与原始网络相比,该方案的精度损失小于1.1%。用于训练和运行所提出的BNN模型的代码可在https://github.com/YulhwaKim/RRAMScalable_BNN上获得。

英文摘要:

Recently, RRAM-based Binary Neural Network (BNN) hardware has been gaining interests as it requires 1-bit sense-amp only and eliminates the need for high-resolution ADC and DAC. However, RRAM-based BNN hardware still requires high-resolution ADC for partial sum calculation to implement large-scale neural network using multiple memory arrays. We propose a neural network-hardware co-design approach to split input to fit each split network on a RRAM array so that the reconstructed BNNs calculate 1-bit output neuron in each array. As a result, ADC can be completely eliminated from the design even for large-scale neural network. Simulation results show that the proposed network reconstruction and retraining recovers the inference accuracy of the original BNN. The accuracy loss of the proposed scheme in the CIFAR-10 testcase was less than 1.1% compared to the original network. The code for training and running proposed BNN models is available at: https://github.com/YulhwaKim/RRAMScalable_BNN.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑