arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2002.12900eess.SPcs.LG
收藏

MajorityNets:利用近似Popcount提高效率的BNN

MajorityNets: BNNs Utilising Approximate Popcount for Improved Efficiency

The University of Sydney(悉尼大学);Fudan University(复旦大学)

Seyedramin Rasoulinezhad, Sean Fox, Hao Zhou, Lingli Wang, David Boland, Philip H. W. Leong

摘要:

二进制神经网络(BNN)已经显示出在嵌入式实现中利用神经网络的令人兴奋的潜力,其中面积,能量和延迟限制是至关重要的。使用BNN,乘法累加(MAC)操作可以简化为XnorPopcount操作,从而大幅减少内存和计算资源。此外,已经报道了在现场可编程门阵列(FPGA)实现上的BNN的多种有效实现。本文提出了一种更小,更快,更节能的近似替代XnorPopcount操作,称为XNorMaj,灵感来自最先进的FPGA查找表方案,有利于FPGA实现。我们知道XNorMaj比XnorPopcount操作的资源效率高出2倍。虽然XNorMaj操作对准确性有轻微的不利影响,但节省的资源使我们能够使用更大的网络来弥补损失。

英文摘要:

Binarized neural networks (BNNs) have shown exciting potential for utilising neural networks in embedded implementations where area, energy and latency constraints are paramount. With BNNs, multiply-accumulate (MAC) operations can be simplified to XnorPopcount operations, leading to massive reductions in both memory and computation resources. Furthermore, multiple efficient implementations of BNNs have been reported on field-programmable gate array (FPGA) implementations. This paper proposes a smaller, faster, more energy-efficient approximate replacement for the XnorPopcountoperation, called XNorMaj, inspired by state-of-the-art FPGAlook-up table schemes which benefit FPGA implementations. Weshow that XNorMaj is up to 2x more resource-efficient than the XnorPopcount operation. While the XNorMaj operation has a minor detrimental impact on accuracy, the resource savings enable us to use larger networks to recover the loss.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑