arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2304.06299cs.AR
收藏

基于逻辑的神经网络高效处理算法与硬件

Algorithms and Hardware for Efficient Processing of Logic-based Neural Networks

Jingkai Hong, Arash Fayyazi, Amirhossein Esmaili, Mahdi Nazemi, Massoud Pedram

AI总结:

本文提出一种将基于固定功能组合逻辑的神经网络编译映射到逻辑处理器的优化方法,结合图划分与调度算法,在VGG16上实现比XNOR加速器高25倍的推理吞吐量。

摘要:

近年来,为满足当今应用需求而提升神经网络(NN)加速器性能的努力,催生了一种依赖固定功能组合逻辑(FFCL)的基于逻辑的神经网络推理新趋势。本文提出了一种创新的优化方法,用于将利用FFCL的神经网络编译并映射到逻辑处理器中。该方法将FFCL模块映射为一组布尔函数,其中每个函数中的布尔运算被映射到高性能、低延迟、并行化的处理单元上。文中提出了图划分与调度算法,以处理无法直接适配逻辑处理器的FFCL模块。我们在多个数据集和神经网络上的实验评估表明,与现有技术的神经网络加速器相比,我们的框架在推理吞吐量方面具有优越性能。对于VGG16模型,我们实现了比基于XNOR的加速器高25倍的吞吐量,并且通过部署图划分与合并算法,该性能还可进一步提升5倍。

英文摘要:

Recent efforts to improve the performance of neural network (NN) accelerators that meet today's application requirements have given rise to a new trend of logic-based NN inference relying on fixed-function combinational logic (FFCL). This paper presents an innovative optimization methodology for compiling and mapping NNs utilizing FFCL into a logic processor. The presented method maps FFCL blocks to a set of Boolean functions where Boolean operations in each function are mapped to high-performance, low-latency, parallelized processing elements. Graph partitioning and scheduling algorithms are presented to handle FFCL blocks that cannot straightforwardly fit the logic processor. Our experimental evaluations across several datasets and NNs demonstrate the superior performance of our framework in terms of the inference throughput compared to prior art NN accelerators. We achieve 25x higher throughput compared with the XNOR-based accelerator for VGG16 model that can be amplified 5x deploying the graph partitioning and merging algorithms.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑