arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2007.10451cs.AR
收藏

HPIPE:面向FPGA的异构层流水稀疏感知CNN推理

HPIPE: Heterogeneous Layer-Pipelined and Sparse-Aware CNN Inference for FPGAs

Mathew Hall, Vaughn Betz

摘要:

我们提出了一种新的卷积神经网络(CNN)加速器架构和FPGA的网络编译器,优于所有以前的工作。我们的网络编译器不是一次处理一层的通用处理元件,而是静态地划分可用的设备资源,并为CNN的每一层构建定制的硬件。通过为每一层构建硬件,我们可以将控制器打包到更少的查找表中,并使用专用路由。这些效率使我们的加速器能够利用2倍的DSP,并以2倍以上的频率在FPGA上进行稀疏CNN加速。我们评估我们的架构上的稀疏Resnet-50和密集的MobileNet Imagenet分类器的Stratix 10 2800 FPGA的性能。我们发现,稀疏Resnet-50模型的批量大小为1/4550图像/秒,这几乎是NVIDIA最快的机器学习目标GPU V100吞吐量的4倍,并且优于FPGA上的所有先前工作。

英文摘要:

We present both a novel Convolutional Neural Network (CNN) accelerator architecture and a network compiler for FPGAs that outperforms all prior work. Instead of having generic processing elements that together process one layer at a time, our network compiler statically partitions available device resources and builds custom-tailored hardware for each layer of a CNN. By building hardware for each layer we can pack our controllers into fewer lookup tables and use dedicated routing. These efficiencies enable our accelerator to utilize 2x the DSPs and operate at more than 2x the frequency of prior work on sparse CNN acceleration on FPGAs. We evaluate the performance of our architecture on both sparse Resnet-50 and dense MobileNet Imagenet classifiers on a Stratix 10 2800 FPGA. We find that the sparse Resnet-50 model has throughput at a batch size of 1 of 4550 images/s, which is nearly 4x the throughput of NVIDIA's fastest machine learning targeted GPU, the V100, and outperforms all prior work on FPGAs.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑