arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2102.05437cs.NE
收藏

基于Ising能量模型的卷积神经网络剪枝

Pruning of Convolutional Neural Networks Using Ising Energy Model

Hojjat Salehinejad, Shahrokh Valaee

摘要:

剪枝是压缩深度神经网络的主要方法之一。在本文中,我们提出了一个优化框架内的伊辛能量模型,用于修剪卷积核和隐藏单元。该模型旨在减少权重核之间的冗余,并检测非活动核/隐藏单元。我们使用ResNets,AlexNet和SqueezeNet在CIFAR-10和CIFAR-100数据集上进行的实验表明,平均而言,所提出的方法可以实现超过$50\%$的可训练参数的修剪率,分别具有近似$<10\%$和$<5\%$的Top-1和Top-5分类准确度下降。

英文摘要:

Pruning is one of the major methods to compress deep neural networks. In this paper, we propose an Ising energy model within an optimization framework for pruning convolutional kernels and hidden units. This model is designed to reduce redundancy between weight kernels and detect inactive kernels/hidden units. Our experiments using ResNets, AlexNet, and SqueezeNet on CIFAR-10 and CIFAR-100 datasets show that the proposed method on average can achieve a pruning rate of more than $50\%$ of the trainable parameters with approximately $<10\%$ and $<5\%$ drop of Top-1 and Top-5 classification accuracy, respectively.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑