arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2303.14593cs.SDeess.AS
收藏

多分辨率频率编解码器辅助的时域语音增强

Time-domain Speech Enhancement Assisted by Multi-resolution Frequency Encoder and Decoder

Kyoto University(京都大学);Tianjin University(天津大学)

Hao Shi, Masato Mimura, Longbiao Wang, Jianwu Dang, Tatsuya Kawahara

摘要:

时域语音增强技术是近年来语音增强领域的研究热点。在最近的作品中,DEMUCS引入了多分辨率STFT损失,以提高性能。然而,用于STFT的一些分辨率包含非平稳信号,并且仅用一个输出同时学习多分辨率频率损失是具有挑战性的。为了更好地利用多分辨率的频率信息,我们补充了多个频谱在不同的帧长度的时域编码器。它们提取窄带和宽带中的平稳频率信息。我们还采用了多个解码器输出,每个输出计算其相应的分辨率频率损失。实验结果表明:(1)在编码器中融合平稳频率特征比融合非平稳特征更有效;(2)多个输出与频率损失一致,提高了性能。在语音库数据集上的实验表明,该方法的PESQ提高了0.14。

英文摘要:

Time-domain speech enhancement (SE) has recently been intensively investigated. Among recent works, DEMUCS introduces multi-resolution STFT loss to enhance performance. However, some resolutions used for STFT contain non-stationary signals, and it is challenging to learn multi-resolution frequency losses simultaneously with only one output. For better use of multi-resolution frequency information, we supplement multiple spectrograms in different frame lengths into the time-domain encoders. They extract stationary frequency information in both narrowband and wideband. We also adopt multiple decoder outputs, each of which computes its corresponding resolution frequency loss. Experimental results show that (1) it is more effective to fuse stationary frequency features than non-stationary features in the encoder, and (2) the multiple outputs consistent with the frequency loss improve performance. Experiments on the Voice-Bank dataset show that the proposed method obtained a 0.14 PESQ improvement.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑