arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2006.10296eess.AScs.LGcs.SD
收藏

基于MetricGAN后处理的语音增强模型客观分数提升

Boosting Objective Scores of a Speech Enhancement Model by MetricGAN Post-processing

National Taiwan University(国立台湾大学);Academia Sinica(中央研究院)

Szu-Wei Fu, Chien-Feng Liao, Tsun-An Hsieh, Kuo-Hsuan Hung, Syu-Siang Wang, Cheng Yu, Heng-Cheng Kuo, Ryandhimas E. Zezario, You-Jin Li, Shang-Yi Chuang, Yen-Ju Lu, Yu Tsao

摘要:

在许多不同的自然语言处理应用中,与递归神经网络相比,Transformer架构已经展示了卓越的能力。因此,我们的研究将改进的Transformer应用于语音增强任务中。具体地,Transformer中的位置编码对于语音增强可能不是必需的,因此,它被卷积层代替。为了进一步提高增强语音的语音质量(PESQ)分数的感知评估,使用MetricGAN框架对L_1预训练的Transformer进行微调。所提出的MetricGAN可以被视为一个通用的后处理模块,以进一步提高感兴趣的客观分数。这些实验是使用深度噪声抑制(DNS)挑战赛组织者提供的数据集进行的。实验结果表明,该系统优于挑战基线,在主观和客观的评价,有很大的利润。

英文摘要:

The Transformer architecture has demonstrated a superior ability compared to recurrent neural networks in many different natural language processing applications. Therefore, our study applies a modified Transformer in a speech enhancement task. Specifically, positional encoding in the Transformer may not be necessary for speech enhancement, and hence, it is replaced by convolutional layers. To further improve the perceptual evaluation of the speech quality (PESQ) scores of enhanced speech, the L_1 pre-trained Transformer is fine-tuned using a MetricGAN framework. The proposed MetricGAN can be treated as a general post-processing module to further boost the objective scores of interest. The experiments were conducted using the data sets provided by the organizer of the Deep Noise Suppression (DNS) challenge. Experimental results demonstrated that the proposed system outperformed the challenge baseline, in both subjective and objective evaluations, with a large margin.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑