arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2309.02111cs.ARcs.ET
收藏

通过电容最小化实现稳健高效的二值化SNN的硬件/软件协同设计

HW/SW Codesign for Robust and Efficient Binarized SNNs by Capacitor Minimization

Mikail Yayla, Simon Thomann, Ming-Liang Wei, Chia-Lin Yang, Jian-Jia Chen, Hussam Amrouch

AI总结:

本文提出CapMin硬件/软件协同设计方法,通过减少脉冲时间数量最小化模拟IF-SNNs的电容尺寸,实现超过14倍缩减,并扩展CapMin-V以增强对电流变化的鲁棒性。

摘要:

使用基于模拟计算的加速器是处理神经网络(NNs)中巨大工作负载的一种高效方式。用于NNs的模拟计算方案的一个例子是Integrate-and-Fire(IF)脉冲神经网络(SNNs)。然而,为了在IF-SNNs中实现高推理精度,模拟硬件需要将基于电流的乘加(MAC)水平表示为脉冲时间,为此需要给一个大膜电容充电一定时间。大电容导致高能耗、相当大的面积成本和长延迟,构成了模拟IF-SNN实现中的主要瓶颈之一。在这项工作中,我们提出了一种名为CapMin的硬件/软件协同设计方法,用于模拟计算IF-SNNs中的电容尺寸最小化。CapMin通过减少硬件精确操作所需的脉冲时间数量来最小化电容尺寸,这是基于软件中MAC水平出现的绝对频率。为了增强IF-SNNs对电流变化的操作,我们提出了CapMin-V方法,该方法基于CapMin中发现的减小后的电容尺寸,以电容尺寸换取保护。在我们的实验中,CapMin在电容尺寸上比现有技术实现了超过14倍的缩减,而CapMin-V在IF-SNN操作中实现了增强的变化容忍度,仅需要电容尺寸的小幅增加。

英文摘要:

Using accelerators based on analog computing is an efficient way to process the immensely large workloads in Neural Networks (NNs). One example of an analog computing scheme for NNs is Integrate-and-Fire (IF) Spiking Neural Networks (SNNs). However, to achieve high inference accuracy in IF-SNNs, the analog hardware needs to represent current-based multiply-accumulate (MAC) levels as spike times, for which a large membrane capacitor needs to be charged for a certain amount of time. A large capacitor results in high energy use, considerable area cost, and long latency, constituting one of the major bottlenecks in analog IF-SNN implementations. In this work, we propose a HW/SW Codesign method, called CapMin, for capacitor size minimization in analog computing IF-SNNs. CapMin minimizes the capacitor size by reducing the number of spike times needed for accurate operation of the HW, based on the absolute frequency of MAC level occurrences in the SW. To increase the operation of IF-SNNs to current variation, we propose the method CapMin-V, which trades capacitor size for protection based on the reduced capacitor size found in CapMin. In our experiments, CapMin achieves more than a 14$\times$ reduction in capacitor size over the state of the art, while CapMin-V achieves increased variation tolerance in the IF-SNN operation, requiring only a small increase in capacitor size.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑