arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1805.04142cs.NEcs.ET
收藏

基于随机计算的深度卷积神经网络预算驱动硬件优化

Towards Budget-Driven Hardware Optimization for Deep Convolutional Neural Networks using Stochastic Computing

Zhe Li, Ji Li, Ao Ren, Caiwen Ding, Jeffrey Draper, Qinru Qiu, Bo Yuan, Yanzhi Wang

摘要:

近年来,深度卷积神经网络(DCNN)在许多机器学习应用中取得了巨大的成功。然而,深层结构带来了计算复杂度的显著增加。大规模深度学习系统主要在高性能服务器集群中运行,因此限制了应用程序扩展到个人或移动设备。以前在DCNN的GPU和/或FPGA加速方面的工作显示出越来越高的加速比,但忽略了其他限制,如面积,功率和能量。随机计算(SC)作为一种独特的数据表示和处理技术,有可能实现大规模深度学习系统的完全并行和可扩展的硬件实现设计。提出了一种以预算需求为驱动、兼顾总体精度性能的自动设计分配算法。这种系统化的方法使得能够自动设计DCNN,其中所有设计参数被联合优化。实验结果表明,该算法可以实现所有设计参数的联合优化给定的综合预算的DCNN。

英文摘要:

Recently, Deep Convolutional Neural Network (DCNN) has achieved tremendous success in many machine learning applications. Nevertheless, the deep structure has brought significant increases in computation complexity. Largescale deep learning systems mainly operate in high-performance server clusters, thus restricting the application extensions to personal or mobile devices. Previous works on GPU and/or FPGA acceleration for DCNNs show increasing speedup, but ignore other constraints, such as area, power, and energy. Stochastic Computing (SC), as a unique data representation and processing technique, has the potential to enable the design of fully parallel and scalable hardware implementations of large-scale deep learning systems. This paper proposed an automatic design allocation algorithm driven by budget requirement considering overall accuracy performance. This systematic method enables the automatic design of a DCNN where all design parameters are jointly optimized. Experimental results demonstrate that proposed algorithm can achieve a joint optimization of all design parameters given the comprehensive budget of a DCNN.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑