NeuroTrainer:一种用于深度学习训练的智能记忆模块
NeuroTrainer: An Intelligent Memory Module for Deep Learning Training
摘要:
本文介绍了NeuroTrainer,一个智能内存模块与内存中的加速器,形成了一个可扩展的架构的构建块,为深度神经网络的能源效率的训练。所提出的架构是基于集成的同质计算基板组成的多个处理引擎的逻辑层的3D存储器模块。NeuroTrainer利用基于可编程数据流的执行模型,在训练操作的不同阶段优化内存映射和数据重用。编程模型和支持架构利用灵活的数据流来有效地加速各种类型的DNN的训练。在15 nm FinFET中的循环级仿真和综合设计显示出500 GFLOPS/W的功率效率,并且对于包括卷积、递归、多层感知器和混合(CNN+RNN)网络在内的各种DNN,具有几乎相似的吞吐量
英文摘要:
This paper presents, NeuroTrainer, an intelligent memory module with in-memory accelerators that forms the building block of a scalable architecture for energy efficient training for deep neural networks. The proposed architecture is based on integration of a homogeneous computing substrate composed of multiple processing engines in the logic layer of a 3D memory module. NeuroTrainer utilizes a programmable data flow based execution model to optimize memory mapping and data re-use during different phases of training operation. A programming model and supporting architecture utilizes the flexible data flow to efficiently accelerate training of various types of DNNs. The cycle level simulation and synthesized design in 15nm FinFET showspower efficiency of 500 GFLOPS/W, and almost similar throughput for a wide range of DNNs including convolutional, recurrent, multi-layer-perceptron, and mixed (CNN+RNN) networks
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。