arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2203.02263eess.AScs.SD
收藏

PercepNet +:相位和SNR感知的实时语音增强PercepNet

PercepNet+: A Phase and SNR Aware PercepNet for Real-Time Speech Enhancement

Shanghai Normal University(上海师范大学);Unisound AI Technology Co., Ltd.(云知声人工智能科技股份有限公司)

Xiaofeng Ge, Jiangyu Han, Yanhua Long, Haixin Guan

摘要:

PercepNet是RNNoise的最新扩展,RNNoise是一种高效,高质量和实时的全频带语音增强技术,在各种公共深度噪声抑制任务中表现出良好的性能。本文提出了一种名为PercepNet+的新方法,通过四项重大改进进一步扩展了PercepNet。首先,我们引入了一种相位感知结构,通过分别添加复特征和复子带增益作为深度网络的输入和输出,将相位信息利用到PercepNet中。然后,一个信号噪声比(SNR)估计和SNR切换后处理的专门设计,以减轻过衰减(OA),出现在高信噪比条件下的原始感知网。此外,GRU层被TF-GRU取代,以模拟时间和频率依赖性。最后,我们提出综合复数子带增益损失、信噪比损失、基音滤波强度损失和一个OA损失,以多目标学习的方式进一步提高语音增强性能。实验结果表明,提出的PercepNet+在PESQ和STOI方面都明显优于原始PercepNet,而没有过多增加模型大小。

英文摘要:

PercepNet, a recent extension of the RNNoise, an efficient, high-quality and real-time full-band speech enhancement technique, has shown promising performance in various public deep noise suppression tasks. This paper proposes a new approach, named PercepNet+, to further extend the PercepNet with four significant improvements. First, we introduce a phase-aware structure to leverage the phase information into PercepNet, by adding the complex features and complex subband gains as the deep network input and output respectively. Then, a signal-to-noise ratio (SNR) estimator and an SNR switched post-processing are specially designed to alleviate the over attenuation (OA) that appears in high SNR conditions of the original PercepNet. Moreover, the GRU layer is replaced by TF-GRU to model both temporal and frequency dependencies. Finally, we propose to integrate the loss of complex subband gain, SNR, pitch filtering strength, and an OA loss in a multi-objective learning manner to further improve the speech enhancement performance. Experimental results show that, the proposed PercepNet+ outperforms the original PercepNet significantly in terms of both PESQ and STOI, without increasing the model size too much.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑