arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1707.09068cs.NE
收藏

Tartan:利用数值精度可变性加速深度学习网络中的全连接层和卷积层

Tartan: Accelerating Fully-Connected and Convolutional Layers in Deep Learning Networks by Exploiting Numerical Precision Variability

Alberto Delmas, Sayeh Sharify, Patrick Judd, Andreas Moshovos

摘要:

Tartan(TRT)是一种用于深度神经网络(DNN)推理的硬件加速器,并在卷积神经网络上进行了评估。TRT利用DNN的可变每层精度要求来提供执行时间,该执行时间与卷积层和全连接层的每层使用的精度p成比例。现有技术已经展示了仅对于卷积层具有相同执行性能的加速器。在图像分类CNN上的实验表明,在研究的所有网络中,TRT的平均性能比最先进的位并行加速器高出1:90倍,而准确性没有任何损失,同时能效高出1:17倍。TRT不需要网络重新训练,同时它可以在执行性能和能源效率的进一步改进中权衡精度。例如,如果1%的相对精度损失是可接受的,则TRT比传统的位并行加速器平均快2:04倍,能效高1:25倍。Tartan配置一次处理2位,比1位配置需要更少的面积,将效率提高到位并行基线的1:24倍,同时卷积层的速度提高了73%,全连接层的速度提高了60%。

英文摘要:

Tartan (TRT), a hardware accelerator for inference with Deep Neural Networks (DNNs), is presented and evaluated on Convolutional Neural Networks. TRT exploits the variable per layer precision requirements of DNNs to deliver execution time that is proportional to the precision p in bits used per layer for convolutional and fully-connected layers. Prior art has demonstrated an accelerator with the same execution performance only for convolutional layers. Experiments on image classification CNNs show that on average across all networks studied, TRT outperforms a state-of-the-art bit-parallel accelerator by 1:90x without any loss in accuracy while it is 1:17x more energy efficient. TRT requires no network retraining while it enables trading off accuracy for additional improvements in execution performance and energy efficiency. For example, if a 1% relative loss in accuracy is acceptable, TRT is on average 2:04x faster and 1:25x more energy efficient than a conventional bit-parallel accelerator. A Tartan configuration that processes 2-bits at time, requires less area than the 1-bit configuration, improves efficiency to 1:24x over the bit-parallel baseline while being 73% faster for convolutional layers and 60% faster for fully-connected layers is also presented.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑