arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2305.13686eess.AS
收藏

MP-SENet:一种幅值与相位谱并行去噪的语音增强模型

MP-SENet: A Speech Enhancement Model with Parallel Denoising of Magnitude and Phase Spectra

Ye-Xin Lu, Yang Ai, Zhen-Hua Ling

AI总结:

本文提出MP-SENet语音增强模型,通过卷积增强Transformer编解码架构并行去噪幅值与相位谱,并利用多级损失联合训练,在VoiceBank+DEMAND数据集上取得3.50的PESQ,优于现有先进方法。

摘要:

本文提出MP-SENet,一种新颖的语音增强网络,可直接并行地对幅值和相位谱进行去噪。所提出的MP-SENet采用编解码器架构,其中编码器与解码器通过卷积增强Transformer桥接。编码器旨在从输入的带噪幅值和相位谱中编码时频表示。解码器由并行的幅值掩码解码器和相位解码器组成,分别通过引入可学习的sigmoid激活函数和并行相位估计架构,直接恢复干净幅值谱和干净缠绕相位谱。定义在幅值谱、相位谱、短时复数谱和时域波形上的多级损失被用于联合训练MP-SENet模型。实验结果表明,我们提出的MP-SENet在公开的VoiceBank+DEMAND数据集上取得了3.50的PESQ,并优于现有的先进语音增强方法。

英文摘要:

This paper proposes MP-SENet, a novel Speech Enhancement Network which directly denoises Magnitude and Phase spectra in parallel. The proposed MP-SENet adopts a codec architecture in which the encoder and decoder are bridged by convolution-augmented transformers. The encoder aims to encode time-frequency representations from the input noisy magnitude and phase spectra. The decoder is composed of parallel magnitude mask decoder and phase decoder, directly recovering clean magnitude spectra and clean-wrapped phase spectra by incorporating learnable sigmoid activation and parallel phase estimation architecture, respectively. Multi-level losses defined on magnitude spectra, phase spectra, short-time complex spectra, and time-domain waveforms are used to train the MP-SENet model jointly. Experimental results show that our proposed MP-SENet achieves a PESQ of 3.50 on the public VoiceBank+DEMAND dataset and outperforms existing advanced speech enhancement methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑