arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1802.00604cs.SDeess.AS
收藏

基于最大化短时客观可懂度的深度神经网络单声道语音增强

Monaural Speech Enhancement using Deep Neural Networks by Maximizing a Short-Time Objective Intelligibility Measure

Aalborg University(奥尔堡大学)

Morten Kolbæk, Zheng-Hua Tan, Jesper Jensen

摘要:

在本文中,我们提出了一种基于深度神经网络(DNN)的语音增强(SE)系统,该系统旨在最大限度地提高短时客观可懂度(STOI)测量的近似值。我们形式化了一个近似的STOI成本函数,并推导出DNN训练所需梯度的解析表达式,并表明这些梯度在与基于梯度的优化技术一起使用时具有理想的特性。我们通过模拟实验表明,所提出的SE系统实现了很大的改善,估计语音清晰度,匹配和不匹配的自然噪声类型,在多个信号噪声比进行测试时。此外,我们表明,SE系统,当训练使用近似STOI成本函数执行与系统训练的均方误差成本应用于短时间的时间包络。最后,我们表明,所提出的SE系统在估计的语音清晰度方面与传统的基于DNN的短时谱幅度(STSA)SE系统表现相当。这些结果很重要,因为它们表明传统的基于DNN的STSA SE系统在估计的语音清晰度方面可能是最佳的。

英文摘要:

In this paper we propose a Deep Neural Network (DNN) based Speech Enhancement (SE) system that is designed to maximize an approximation of the Short-Time Objective Intelligibility (STOI) measure. We formalize an approximate-STOI cost function and derive analytical expressions for the gradients required for DNN training and show that these gradients have desirable properties when used together with gradient based optimization techniques. We show through simulation experiments that the proposed SE system achieves large improvements in estimated speech intelligibility, when tested on matched and unmatched natural noise types, at multiple signal-to-noise ratios. Furthermore, we show that the SE system, when trained using an approximate-STOI cost function performs on par with a system trained with a mean square error cost applied to short-time temporal envelopes. Finally, we show that the proposed SE system performs on par with a traditional DNN based Short-Time Spectral Amplitude (STSA) SE system in terms of estimated speech intelligibility. These results are important because they suggest that traditional DNN based STSA SE systems might be optimal in terms of estimated speech intelligibility.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑