MajorityNets:利用近似Popcount提高效率的BNN
MajorityNets: BNNs Utilising Approximate Popcount for Improved Efficiency
摘要:
二进制神经网络(BNN)已经显示出在嵌入式实现中利用神经网络的令人兴奋的潜力,其中面积,能量和延迟限制是至关重要的。使用BNN,乘法累加(MAC)操作可以简化为XnorPopcount操作,从而大幅减少内存和计算资源。此外,已经报道了在现场可编程门阵列(FPGA)实现上的BNN的多种有效实现。本文提出了一种更小,更快,更节能的近似替代XnorPopcount操作,称为XNorMaj,灵感来自最先进的FPGA查找表方案,有利于FPGA实现。我们知道XNorMaj比XnorPopcount操作的资源效率高出2倍。虽然XNorMaj操作对准确性有轻微的不利影响,但节省的资源使我们能够使用更大的网络来弥补损失。
英文摘要:
Binarized neural networks (BNNs) have shown exciting potential for utilising neural networks in embedded implementations where area, energy and latency constraints are paramount. With BNNs, multiply-accumulate (MAC) operations can be simplified to XnorPopcount operations, leading to massive reductions in both memory and computation resources. Furthermore, multiple efficient implementations of BNNs have been reported on field-programmable gate array (FPGA) implementations. This paper proposes a smaller, faster, more energy-efficient approximate replacement for the XnorPopcountoperation, called XNorMaj, inspired by state-of-the-art FPGAlook-up table schemes which benefit FPGA implementations. Weshow that XNorMaj is up to 2x more resource-efficient than the XnorPopcount operation. While the XNorMaj operation has a minor detrimental impact on accuracy, the resource savings enable us to use larger networks to recover the loss.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。