PRUNIX:用于忆阻加速器的非理想感知卷积神经网络修剪
PRUNIX: Non-Ideality Aware Convolutional Neural Network Pruning for Memristive Accelerators
摘要:
在这项工作中,PRUNIX,一个框架,用于训练和修剪卷积神经网络提出了部署在忆阻器交叉杆为基础的加速器。PRUNIX考虑了忆阻器交叉杆的许多非理想效应,包括权重量化、状态漂移、老化和故障固定。PRUNIX利用一种新的组锯齿正则化,旨在提高非理想性容限以及稀疏性,以及一种新的自适应修剪算法(APA),旨在通过考虑CNN的不同层对修剪的敏感性来最大限度地减少准确性损失。我们将我们的正则化和修剪方法与多个CNN架构上的其他标准进行了比较,并观察到当量化和其他非理想效应被占时,测试精度提高了13%,总体稀疏度为85%,这与其他方法相似
英文摘要:
In this work, PRUNIX, a framework for training and pruning convolutional neural networks is proposed for deployment on memristor crossbar based accelerators. PRUNIX takes into account the numerous non-ideal effects of memristor crossbars including weight quantization, state-drift, aging and stuck-at-faults. PRUNIX utilises a novel Group Sawtooth Regularization intended to improve non-ideality tolerance as well as sparsity, and a novel Adaptive Pruning Algorithm (APA) intended to minimise accuracy loss by considering the sensitivity of different layers of a CNN to pruning. We compare our regularization and pruning methods with other standards on multiple CNN architectures, and observe an improvement of 13% test accuracy when quantization and other non-ideal effects are accounted for with an overall sparsity of 85%, which is similar to other methods
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。