arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2406.07929cs.LGcs.AI
收藏

一种用于信号调制识别深度学习模型的通用层剪枝方法

A Generic Layer Pruning Method for Signal Modulation Recognition Deep Learning Models

Zhejiang University of Technology(浙江工业大学);Binjiang Institute of Artificial Intelligence, Zhejiang University of Technology(浙江工业大学滨江人工智能研究院);Institute of Cyberspace Security, College of Information Engineering, Zhejiang University of Technology(浙江工业大学信息工程学院网络空间安全研究院);Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);Harbin Engineering University(哈尔滨工程大学);PCL Research Center of Networks and Communications, Peng Cheng Laboratory(鹏城实验室PCL网络与通信研究中心);Utron Technology Company Ltd.(优创科技有限公司);Science and Technology on Communication Information Security Control Laboratory(通信信息安全控制重点实验室)

Yao Lu, Yutao Zhu, Yuqi Li, Dongwei Xu, Yun Lin, Qi Xuan, Xiaoniu Yang

AI总结:

针对信号调制识别深度模型计算复杂、体积庞大的问题,提出按语义连续分块、依据层贡献剪枝并重组微调的通用层剪枝方法,在五个数据集上优于多种现有剪枝基线。

摘要:

随着深度学习在通信系统中的成功应用,深度神经网络正成为信号分类的首选方法。尽管这些模型取得了令人瞩目的结果,但它们通常伴随着较高的计算复杂度和较大的模型规模,这阻碍了其在通信系统中的实际部署。为应对这一挑战,我们提出了一种新颖的层剪枝方法。具体而言,我们将模型分解为若干连续块,每个块包含具有相似语义的连续层。随后,我们根据各层的贡献识别每个块内需要保留的层。最后,我们重新组装经过剪枝的块,并对紧凑模型进行微调。在五个数据集上进行的大量实验表明,相较于包括层剪枝和通道剪枝方法在内的多种最先进基线,我们的方法兼具效率与有效性。

英文摘要:

With the successful application of deep learning in communications systems, deep neural networks are becoming the preferred method for signal classification. Although these models yield impressive results, they often come with high computational complexity and large model sizes, which hinders their practical deployment in communication systems. To address this challenge, we propose a novel layer pruning method. Specifically, we decompose the model into several consecutive blocks, each containing consecutive layers with similar semantics. Then, we identify layers that need to be preserved within each block based on their contribution. Finally, we reassemble the pruned blocks and fine-tune the compact model. Extensive experiments on five datasets demonstrate the efficiency and effectiveness of our method over a variety of state-of-the-art baselines, including layer pruning and channel pruning methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑