使用参数修剪和量化技术提高基于深度学习的语音增强模型的紧凑性
Increasing Compactness Of Deep Learning Based Speech Enhancement Models With Parameter Pruning And Quantization Techniques
摘要:
最近关于基于深度学习的语音增强(SE)的研究主要集中在提高去噪性能上。然而,成功的SE应用需要在真实场景中的去噪性能和计算成本之间取得理想的平衡。在这项研究中,我们提出了一种新的参数修剪(PP)技术,它消除了神经网络中的冗余通道。此外,一个参数量化(PQ)技术被应用到减少神经网络的规模表示权值与更少的聚类质心。由于这些技术是基于不同的概念导出的,因此可以集成PP和PQ以提供更紧凑的SE模型。实验结果表明,PP和PQ技术产生一个紧凑的SE模型的大小只有10.03%相比,原来的模型,导致轻微的性能损失为1.43%(从0.70到0.69)的STOI和3.24%(从1.85到1.79)的PESQ。有希望的结果表明,PP和PQ技术可以用于SE系统中的设备与有限的存储和计算资源。
英文摘要:
Most recent studies on deep learning based speech enhancement (SE) focused on improving denoising performance. However, successful SE applications require striking a desirable balance between denoising performance and computational cost in real scenarios. In this study, we propose a novel parameter pruning (PP) technique, which removes redundant channels in a neural network. In addition, a parameter quantization (PQ) technique was applied to reduce the size of a neural network by representing weights with fewer cluster centroids. Because the techniques are derived based on different concepts, the PP and PQ can be integrated to provide even more compact SE models. The experimental results show that the PP and PQ techniques produce a compacted SE model with a size of only 10.03% compared to that of the original model, resulting in minor performance losses of 1.43% (from 0.70 to 0.69) for STOI and 3.24% (from 1.85 to 1.79) for PESQ. The promising results suggest that the PP and PQ techniques can be used in a SE system in devices with limited storage and computation resources.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。